-- Logs begin at Mon 2022-10-03 14:11:27 UTC, end at Mon 2022-10-03 14:53:20 UTC. -- Oct 03 14:37:27.019928 dv-cinder-859877-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 03 14:37:27.028838 dv-cinder-859877-2-smb devstack@keystone.service[87843]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 14:37:27 2022] *** Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: nodename: dv-cinder-859877-2-smb Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: machine: x86_64 Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: clock source: unix Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: pcre jit disabled Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: detected number of CPU cores: 4 Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: current working directory: / Oct 03 14:37:27.030846 dv-cinder-859877-2-smb devstack@keystone.service[87843]: detected binary path: /usr/bin/uwsgi-core Oct 03 14:37:27.031430 dv-cinder-859877-2-smb devstack@keystone.service[87843]: your processes number limit is 47680 Oct 03 14:37:27.031430 dv-cinder-859877-2-smb devstack@keystone.service[87843]: your memory page size is 4096 bytes Oct 03 14:37:27.031430 dv-cinder-859877-2-smb devstack@keystone.service[87843]: detected max file descriptor number: 2048 Oct 03 14:37:27.031430 dv-cinder-859877-2-smb devstack@keystone.service[87843]: lock engine: pthread robust mutexes Oct 03 14:37:27.031430 dv-cinder-859877-2-smb devstack@keystone.service[87843]: thunder lock: enabled Oct 03 14:37:27.031430 dv-cinder-859877-2-smb devstack@keystone.service[87843]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 03 14:37:27.031430 dv-cinder-859877-2-smb devstack@keystone.service[87843]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 14:37:27.071438 dv-cinder-859877-2-smb devstack@keystone.service[87843]: Python main interpreter initialized at 0x5634f4d949c0 Oct 03 14:37:27.071438 dv-cinder-859877-2-smb devstack@keystone.service[87843]: python threads support enabled Oct 03 14:37:27.071438 dv-cinder-859877-2-smb devstack@keystone.service[87843]: your server socket listen backlog is limited to 100 connections Oct 03 14:37:27.071438 dv-cinder-859877-2-smb devstack@keystone.service[87843]: your mercy for graceful operations on workers is 90 seconds Oct 03 14:37:27.071809 dv-cinder-859877-2-smb devstack@keystone.service[87843]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 14:37:27.071889 dv-cinder-859877-2-smb devstack@keystone.service[87843]: *** Operational MODE: preforking *** Oct 03 14:37:27.072130 dv-cinder-859877-2-smb devstack@keystone.service[87843]: *** uWSGI is running in multiple interpreter mode *** Oct 03 14:37:27.072130 dv-cinder-859877-2-smb devstack@keystone.service[87843]: spawned uWSGI master process (pid: 87843) Oct 03 14:37:27.072336 dv-cinder-859877-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 03 14:37:27.078706 dv-cinder-859877-2-smb devstack@keystone.service[87843]: spawned uWSGI worker 1 (pid: 87856, cores: 1) Oct 03 14:37:27.078706 dv-cinder-859877-2-smb devstack@keystone.service[87843]: spawned uWSGI worker 2 (pid: 87857, cores: 1) Oct 03 14:37:27.078706 dv-cinder-859877-2-smb devstack@keystone.service[87843]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 14:37:31.446568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:37:31.446568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: from cryptography.utils import int_from_bytes Oct 03 14:37:31.447357 dv-cinder-859877-2-smb devstack@keystone.service[87856]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:37:31.447357 dv-cinder-859877-2-smb devstack@keystone.service[87856]: from cryptography.utils import int_from_bytes Oct 03 14:37:31.450861 dv-cinder-859877-2-smb devstack@keystone.service[87857]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:37:31.450861 dv-cinder-859877-2-smb devstack@keystone.service[87857]: from cryptography.utils import int_from_bytes Oct 03 14:37:31.451327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 14:37:31.451327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: from cryptography.utils import int_from_bytes Oct 03 14:37:31.497074 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:37:31.497270 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:37:31.497459 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] command line args: [] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:37:31.497727 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:37:31.497902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ================================================================================ {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:37:31.498155 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] admin_token = **** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.498400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] config_dir = [] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.498586 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.498766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] config_source = [] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.498965 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] debug = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.499167 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.500343 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.500343 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.500343 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.500343 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.500640 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] list_limit = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.500707 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] log_config_append = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.500890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.501066 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] log_dir = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.501241 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] log_file = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.501418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 14:37:31.501497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.501617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 14:37:31.501702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.501820 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] command line args: [] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 14:37:31.501959 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.502098 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 14:37:31.502208 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.502299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ================================================================================ {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 14:37:31.502380 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.502528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] admin_token = **** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.502610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.502780 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.502864 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] config_dir = [] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.502987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.503078 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.503180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] config_source = [] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.503279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.503355 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] debug = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.503513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.503598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.503747 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.503826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.503950 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.504037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.504211 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.504288 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.504458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.504533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.504690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] list_limit = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.504772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.504871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] log_config_append = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.505048 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.505207 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.505285 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] log_dir = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.505388 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] publish_errors = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.505476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] log_file = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.505620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.505698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.505850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.505933 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.506026 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.506101 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.506271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.506355 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.506506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.506591 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.506670 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.506740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] standard_threads = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.506915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507190 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507276 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] use_journal = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507649 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507727 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] use_json = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] use_stderr = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.507948 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.508045 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] use_syslog = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.508139 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.508275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.508353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.508527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.508603 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.508763 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.508839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.509021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.509259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.509335 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.509476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] publish_errors = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.509609 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.509710 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.509793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.509940 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.510024 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.510118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.510202 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.510366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.510442 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.510605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.510687 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.510839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] standard_threads = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.510928 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.511096 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.511181 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.511340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.511417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.511516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.511604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.511697 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] use_journal = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.511823 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.511907 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] use_json = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.512034 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] use_stderr = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.512117 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.512197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] use_syslog = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.512295 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.512436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 14:37:31.512549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.512692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.512801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.512932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.513045 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.513192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.513275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.513431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.513580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.513666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.513749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.513910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.513987 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.514160 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.514260 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.514398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.514476 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.514645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.514727 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.514878 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.515008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.515165 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.515240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.515378 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.515455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.515622 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.515706 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.515854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.515933 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.516659 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.516913 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.516990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.517164 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.517242 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.517404 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.517486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.517652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.517735 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.517885 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.517967 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.518121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.518221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.518356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.518462 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.518584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.518720 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.518816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.519015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.519129 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.519272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.519367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.519512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.519589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.519749 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.519824 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.519978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.520062 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.520211 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.520286 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.520438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.520515 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.520674 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.520761 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.520909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.520987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.521147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.521222 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.521374 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.521525 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.521598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.521669 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.521833 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.521917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.522068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.522155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.522306 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.522385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.522539 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.522615 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.522766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.522854 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.523032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.523112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.523268 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.523345 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.523501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.523590 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.523731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.523808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.523960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.524037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.524200 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.524318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.524425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.524521 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.524656 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.524765 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.524870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.524975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.525116 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.525225 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.525353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.525438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.525589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.525675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.525838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.525921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.526073 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.526191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.526307 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.526436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.526524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.526598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.526766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.526845 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.527026 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.527109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.527263 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.527351 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.527476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.527552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.527729 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.527807 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.527963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.528041 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.528197 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.528273 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.528428 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.528513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.528661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.528739 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.528895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.528972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.529127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.529204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.529362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.529441 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.529602 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.529681 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.529846 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.529923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.530088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.530166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.530326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.530410 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.530567 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.530645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.530802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.530885 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.531060 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.531139 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.531296 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.531373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.531524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.531610 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.532420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.532665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.532916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.533075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.533166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.533316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.533424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.533561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.533669 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.533801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.533956 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.534053 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.534152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.534294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.534375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.534552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.534639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.534816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.534895 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.535084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.535165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.535320 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] auth.external = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.535399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.535553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.535633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.535815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.535892 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.536059 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.536137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.536291 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] auth.password = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.536370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.536522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] auth.token = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.536606 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.536762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.536839 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.536994 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.537073 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.537229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.537305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.537460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.537547 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.537692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.537779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.537925 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.538006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.538161 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.538244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.538390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.538468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] credential.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.538631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.538710 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.538869 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.538966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.539140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.539218 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.539378 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.539458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.539619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.539712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.539852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.539935 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.540098 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.540178 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.540335 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] auth.external = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.540412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.540570 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.540648 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.540819 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.540906 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.541093 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.541171 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.541326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] auth.password = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.541406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.541560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] auth.token = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.541640 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.541801 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.541879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.542038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.542116 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.542280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] federation.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.542359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.542510 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.542593 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.542756 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.542833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.543026 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.543111 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.543259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.543348 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.543494 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] credential.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.543573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.543732 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.543810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.543980 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.544058 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.544216 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.544294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.544471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.544549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.544706 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.544785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.544939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.545024 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.545175 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.545253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.545422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.545502 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.545656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.545741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.545890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.545968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.546124 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.546203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.546372 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.546461 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.546602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.546681 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.546838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.546917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.547115 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.547210 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.547397 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.547774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.547942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] federation.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.548022 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.548193 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.548349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.548446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.548526 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.548692 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.548769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.548928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.549049 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.549175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.549262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.549418 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.549497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.549680 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.549826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.549953 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.550075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.550199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.550324 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.550450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.550585 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.550709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.550829 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551020 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551272 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551445 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551518 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551729 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.551991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.552115 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.552242 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.552368 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.552492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.552617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.552764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.552894 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.553021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.553122 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.553249 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.553376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.553517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.553658 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.553785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.553914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554013 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554087 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554170 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554316 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554387 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554681 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.554839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.555036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.555172 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.555318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.555440 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.555565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.555700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.555827 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.555953 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556090 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556518 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.556971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.557127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.557206 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.557358 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.557438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.557599 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.557679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.557858 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.557937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.558091 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.558171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.558339 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.558419 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.558586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.558664 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.558822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.558902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.559081 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.559161 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.559314 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.559391 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.559547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.559634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.559782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.559862 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.560019 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.560099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.560251 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.560338 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.560487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.560565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.560731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.560808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.560977 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.561056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.561211 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.561290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.561443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.561522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.561671 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.561751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.561918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.561998 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.562156 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.562234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.562397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.562494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.562625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.562745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.562861 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.563954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.564046 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.564230 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.564346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.564477 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.564625 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.564733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.564892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.564979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.565179 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.565315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.565444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.565571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.565713 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.565840 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.565960 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.566083 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.566212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.566338 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.566480 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.566586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.566661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.566733 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.566813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.566937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.567110 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] resource.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.567238 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.567365 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.567501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.567628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.567755 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.567896 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.568027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.568157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.568262 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.568388 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.568518 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.568657 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.568784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.568910 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569035 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569145 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569306 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] role.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] role.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569798 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.569885 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.570054 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.570195 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.570325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.570459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.570605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.570737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.570867 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571184 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571347 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.571965 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.572041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.572201 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.572282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.572450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.572531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.572689 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.572767 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.572935 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.573013 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.573185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] resource.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.573334 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.573444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.573572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.573704 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.573822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.573947 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.574072 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.574210 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.574318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.574468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.574568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.574711 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.574790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.574982 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.575066 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.575232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.575311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.575477 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.575555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.575718 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] role.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.575800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.575973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] role.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.576052 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.576203 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.576280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.576461 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.576557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.576709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.576786 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.576957 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.577036 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.577195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.577275 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.577430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.577508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.577660 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.577739 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.577896 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] token.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.577976 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.578134 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.578213 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.578382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.578471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.579166 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.579258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.579437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.579517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.579689 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.579835 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.579919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.579992 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.580157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.580392 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.580471 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.580637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.580717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.580873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.580952 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.581109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.581188 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.581340 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.581420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.581584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.581663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.581848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.581926 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.582075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.582163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.582314 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.582395 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.582578 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.582657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.582817 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.582903 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.connection = **** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.583082 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.583164 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.583323 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.583402 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.583563 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.583651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.583803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.583883 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.584040 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.584119 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.584278 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.584366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.584516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.584602 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.584752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.584832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.584993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] token.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.585079 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.585226 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.585305 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.585470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.585550 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.585703 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.585790 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.585950 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.586030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.586184 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.586264 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.586426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.586514 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.586656 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.586736 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.586893 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.586990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.587154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.587252 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.587328 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:37:31.587400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.587644 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.587887 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.588144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.588435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.588673 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.588923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.589198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.589468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.connection = **** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.589719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.589974 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.590220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.590467 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.590712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.590968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.591219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.591461 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.591713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.591957 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.592208 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.592449 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.592703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.592945 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.593198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.593436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.593682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.593929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 14:37:31.594102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 14:37:31.616339 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.616572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.616800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.619192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.619430 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.619657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.625296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.628823 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.654112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.654344 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.655194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.655434 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.707677 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.708011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.756680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.756822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.756911 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.757010 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.912731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.912956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.913179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.913265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.913400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.913489 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.913619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.913702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.913834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.913926 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.914065 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.914289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.937105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.937338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.937423 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.937567 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.937650 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.937791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.937876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.938152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.938257 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.938373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.938457 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.938591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.938673 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.938807 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.949621 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.949992 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.962804 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.962976 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.963068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.963208 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.963292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.963437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.963520 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.963662 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.963755 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.963881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.963964 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.964098 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.964180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87857) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.964319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87856) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 14:37:31.980984 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.981194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 14:37:31.981279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.981489 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 14:37:31.981571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.981727 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 14:37:31.981834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.982008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.982091 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 14:37:31.982276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.982367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.982539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.982619 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.982798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.982876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.983080 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.993081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.993368 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.993452 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.993647 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.993730 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.993938 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.994023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:31.994235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.001937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.002218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.004895 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.005135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.005219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.005423 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.005505 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.005715 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.005811 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.006002 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.006085 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.006279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.006360 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.006539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.006621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.006809 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.006893 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.007112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.007207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.007386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.007468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.007660 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.007740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.007926 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.030452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.030721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.032056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.032340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.032432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.032624 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.037051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.037297 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.037381 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.037584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.037680 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.037867 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.044024 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.044197 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.044319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.044487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.050538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.050641 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.050830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.050913 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.051145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.051243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.051439 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.051521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.051722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.051803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.052004 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.052087 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.052281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.052362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.052548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.052629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.068040 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.068304 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.068388 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.068588 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.072114 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.072472 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.075300 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.075601 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.075742 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.076043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.080292 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.080841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.083365 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.085800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.086545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.086848 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.087159 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.087234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.087445 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.087519 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.088083 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.088162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.088236 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.088320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.088320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.088568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.104218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.104509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.104779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.104903 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.105043 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.105202 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.105477 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.105749 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.112161 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.112833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.113689 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.114353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.115239 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.115519 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.115904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.116188 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.118154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.118443 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.118726 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.118900 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.119052 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.119226 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.119425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.119572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.119800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.120453 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.130902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.131214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.131495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.131776 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.132023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.132158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.132322 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.132451 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.132614 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.132742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.132905 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.133292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.133578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.133880 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.148615 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.150205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.151552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.153164 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.154555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.156081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.156170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.158171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.158378 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.158665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.159090 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.159691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.159979 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.160377 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.165429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.166786 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.166902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.168302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.169791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.170190 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.170479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.170758 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.171216 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.171622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.171914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.172197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.178808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.179125 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.179413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.180250 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.180548 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.180835 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.186247 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87856) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.186539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.186822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.187142 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.187418 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.187691 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.187773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87857) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 14:37:32.188048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.188165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.188327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.188455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.188597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.188740 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.188884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.189012 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.189177 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.189323 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.189442 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.189563 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.189708 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.189843 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.189975 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87856) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.190128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.190409 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.190686 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.190974 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.191246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.191534 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87857) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 14:37:32.224227 dv-cinder-859877-2-smb devstack@keystone.service[87856]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5634f4d949c0 pid: 87856 (default app) Oct 03 14:37:32.226408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5634f4d949c0 pid: 87857 (default app) Oct 03 14:37:32.227450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c968-6d3c-443f-b440-0200b516fabd None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:32.227739 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c968-6d3c-443f-b440-0200b516fabd None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:32.228012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c968-6d3c-443f-b440-0200b516fabd None None] PATH_INFO: `/v3` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:32.232131 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Mon Oct 3 14:37:32 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:37:39.012136 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d8e9-f74c-4e83-a22c-41e1811a901e None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:39.012692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d8e9-f74c-4e83-a22c-41e1811a901e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:39.012692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d8e9-f74c-4e83-a22c-41e1811a901e None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:39.017639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:39.022780 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:39.023358 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:39.023358 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:39.096293 dv-cinder-859877-2-smb devstack@keystone.service[87856]: INFO dbcounter [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] Registered counter for database keystone Oct 03 14:37:39.115514 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG oslo_db.sqlalchemy.engines [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:37:39.122153 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writer thread running {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:37:39.304154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG passlib.handlers.bcrypt [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87856) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 03 14:37:39.304466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG passlib.handlers.bcrypt [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87856) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 03 14:37:39.362695 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:39.364333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:39.493084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 03 14:37:39.793320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04d8e9-f74c-4e83-a22c-41e1811a901e None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:39.864638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: INFO dbcounter [None req-ff04d8e9-f74c-4e83-a22c-41e1811a901e None None] Registered counter for database keystone Oct 03 14:37:39.885889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG oslo_db.sqlalchemy.engines [None req-ff04d8e9-f74c-4e83-a22c-41e1811a901e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 14:37:39.892109 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writer thread running {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 14:37:40.011185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04d8e9-f74c-4e83-a22c-41e1811a901e None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:40.015369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833dd1c-cbaa-4f67-a5a4-259e10b165b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:40.016155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833dd1c-cbaa-4f67-a5a4-259e10b165b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:40.016540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833dd1c-cbaa-4f67-a5a4-259e10b165b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:40.016823 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833dd1c-cbaa-4f67-a5a4-259e10b165b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:40.025008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833dd1c-cbaa-4f67-a5a4-259e10b165b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:40.077023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6833dd1c-cbaa-4f67-a5a4-259e10b165b1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 03 14:37:40.077317 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833dd1c-cbaa-4f67-a5a4-259e10b165b1 admin admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:40.086812 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Oct 3 14:37:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 14:37:40.092778 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:40.111439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca18ffd-9be1-4b1d-b75e-659b00b4435e None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:40.115863 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119d000-cc32-4298-a5f6-251d6f749233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:40.116969 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119d000-cc32-4298-a5f6-251d6f749233 admin admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:40.117254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119d000-cc32-4298-a5f6-251d6f749233 admin admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:40.117531 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119d000-cc32-4298-a5f6-251d6f749233 admin admin] PATH_INFO: `/v3/projects/cf0b8451292a4b79a7b878d287636467` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:40.119154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119d000-cc32-4298-a5f6-251d6f749233 admin admin] RBAC: Authorizing `identity:get_project(project_id=cf0b8451292a4b79a7b878d287636467)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:40.172068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3119d000-cc32-4298-a5f6-251d6f749233 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 03 14:37:40.172990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119d000-cc32-4298-a5f6-251d6f749233 admin admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:40.177487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Mon Oct 3 14:37:40 2022] GET /identity/v3/projects/cf0b8451292a4b79a7b878d287636467 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:42.296662 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2db64-b270-4af8-b8fb-a45bce13d89b None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:42.297752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2db64-b270-4af8-b8fb-a45bce13d89b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:42.297752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2db64-b270-4af8-b8fb-a45bce13d89b None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:42.301834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:37:42.307467 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf9758-6deb-46fb-be89-cbe4bb68f62f None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:42.307870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf9758-6deb-46fb-be89-cbe4bb68f62f None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:42.308024 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf9758-6deb-46fb-be89-cbe4bb68f62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:42.327589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-cdcf9758-6deb-46fb-be89-cbe4bb68f62f None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:42.329463 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-cdcf9758-6deb-46fb-be89-cbe4bb68f62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:42.337123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 03 14:37:42.605309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2db64-b270-4af8-b8fb-a45bce13d89b None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:42.617438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2db64-b270-4af8-b8fb-a45bce13d89b None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:42.621818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2eea7d-70b6-455e-8bee-627c33f6bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:42.622411 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eea7d-70b6-455e-8bee-627c33f6bfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:42.622689 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eea7d-70b6-455e-8bee-627c33f6bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:42.622978 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eea7d-70b6-455e-8bee-627c33f6bfe8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:42.630436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2eea7d-70b6-455e-8bee-627c33f6bfe8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:42.632252 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2eea7d-70b6-455e-8bee-627c33f6bfe8 admin admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:42.640730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Oct 3 14:37:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 14:37:42.646577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf9758-6deb-46fb-be89-cbe4bb68f62f None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:42.655499 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf9758-6deb-46fb-be89-cbe4bb68f62f None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:42.660369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d8d3-8d68-4bb6-8630-81f3bf8546bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:42.661022 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d8d3-8d68-4bb6-8630-81f3bf8546bd admin admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:42.661304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d8d3-8d68-4bb6-8630-81f3bf8546bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:42.661792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d8d3-8d68-4bb6-8630-81f3bf8546bd admin admin] PATH_INFO: `/v3/users/eb12f0f56c9240608c4e9af189715bfa` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:42.663338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3d8d3-8d68-4bb6-8630-81f3bf8546bd admin admin] RBAC: Authorizing `identity:get_user(user_id=eb12f0f56c9240608c4e9af189715bfa)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:42.665297 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3d8d3-8d68-4bb6-8630-81f3bf8546bd admin admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:42.666810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Mon Oct 3 14:37:42 2022] GET /identity/v3/users/eb12f0f56c9240608c4e9af189715bfa => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:37:44.913621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed97fda-d9ca-47dd-b717-f2fd2878da7e None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:44.914189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed97fda-d9ca-47dd-b717-f2fd2878da7e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:44.914189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed97fda-d9ca-47dd-b717-f2fd2878da7e None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:44.915156 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d72f9a-0b46-483c-88f9-c070319f62ab None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:44.915534 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d72f9a-0b46-483c-88f9-c070319f62ab None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:44.915626 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:44.915788 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d72f9a-0b46-483c-88f9-c070319f62ab None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:44.917114 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:37:44.920584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5e24-fe4e-4270-a90d-90cc4875e7c8 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:44.920953 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5e24-fe4e-4270-a90d-90cc4875e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:44.921240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5e24-fe4e-4270-a90d-90cc4875e7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:44.922739 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51570798-5e9b-4a61-b291-1ea40f627d33 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:44.923149 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51570798-5e9b-4a61-b291-1ea40f627d33 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:44.923435 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51570798-5e9b-4a61-b291-1ea40f627d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:44.941510 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-51570798-5e9b-4a61-b291-1ea40f627d33 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:44.942683 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-51570798-5e9b-4a61-b291-1ea40f627d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:44.963920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG passlib.handlers.bcrypt [None req-3f0a5e24-fe4e-4270-a90d-90cc4875e7c8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87857) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 03 14:37:44.964296 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG passlib.handlers.bcrypt [None req-3f0a5e24-fe4e-4270-a90d-90cc4875e7c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87857) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 03 14:37:45.013284 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-3f0a5e24-fe4e-4270-a90d-90cc4875e7c8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:45.014843 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-3f0a5e24-fe4e-4270-a90d-90cc4875e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:45.025432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 7/12] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:37:45.115208 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 6/13] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:45.295055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51570798-5e9b-4a61-b291-1ea40f627d33 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:45.320007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:45.385061 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a5e24-fe4e-4270-a90d-90cc4875e7c8 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:45.398762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51570798-5e9b-4a61-b291-1ea40f627d33 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:45.432917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733aaaf-ed0c-4259-8f90-630118babeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:45.433559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733aaaf-ed0c-4259-8f90-630118babeed None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:45.433837 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733aaaf-ed0c-4259-8f90-630118babeed None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:45.434110 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733aaaf-ed0c-4259-8f90-630118babeed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:45.445328 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733aaaf-ed0c-4259-8f90-630118babeed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-6733aaaf-ed0c-4259-8f90-630118babeed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:37:45.455487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:37:45.456606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:37:45.457469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 8/14] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:37:45.462330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733aaaf-ed0c-4259-8f90-630118babeed None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:45.488114 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a5e24-fe4e-4270-a90d-90cc4875e7c8 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:45.490436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:45.526396 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8abc-40e2-4b6e-9101-81762f2fadd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:45.527284 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8abc-40e2-4b6e-9101-81762f2fadd1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:45.527570 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8abc-40e2-4b6e-9101-81762f2fadd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:45.527844 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8abc-40e2-4b6e-9101-81762f2fadd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:45.545003 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:45.563580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733aaaf-ed0c-4259-8f90-630118babeed None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:45.596446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8abc-40e2-4b6e-9101-81762f2fadd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:45.597654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dc394-154d-453c-8c09-6a28ea1b60c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:45.597959 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8abc-40e2-4b6e-9101-81762f2fadd1 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:45.598268 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc394-154d-453c-8c09-6a28ea1b60c9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:45.598552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc394-154d-453c-8c09-6a28ea1b60c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:45.598836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dc394-154d-453c-8c09-6a28ea1b60c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:45.599535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dc394-154d-453c-8c09-6a28ea1b60c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:37:45.599842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dc394-154d-453c-8c09-6a28ea1b60c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:45.601215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dc394-154d-453c-8c09-6a28ea1b60c9 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:45.613206 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 9/15] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:45.618672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dc394-154d-453c-8c09-6a28ea1b60c9 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:45.696478 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 7/16] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 14:37:45.701991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8abc-40e2-4b6e-9101-81762f2fadd1 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:45.705570 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:45.722179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dc394-154d-453c-8c09-6a28ea1b60c9 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:45.755185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9691-1091-488c-9042-f7994fc0e823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:45.755899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9691-1091-488c-9042-f7994fc0e823 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:45.756186 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9691-1091-488c-9042-f7994fc0e823 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:45.756462 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9691-1091-488c-9042-f7994fc0e823 None admin] PATH_INFO: `/v3/users/eb12f0f56c9240608c4e9af189715bfa` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:45.757598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd9691-1091-488c-9042-f7994fc0e823 None admin] RBAC: Authorizing `identity:get_user(user_id=eb12f0f56c9240608c4e9af189715bfa)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:45.759062 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd9691-1091-488c-9042-f7994fc0e823 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:45.760623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 10/17] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:37:45 2022] GET /identity/v3/users/eb12f0f56c9240608c4e9af189715bfa => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:45.766651 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9691-1091-488c-9042-f7994fc0e823 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:45.781035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:45.801426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8abc-40e2-4b6e-9101-81762f2fadd1 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:45.835102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d53e1-ff66-4198-b01e-2ade267671c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:45.835956 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d53e1-ff66-4198-b01e-2ade267671c1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:45.836237 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d53e1-ff66-4198-b01e-2ade267671c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:45.836506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d53e1-ff66-4198-b01e-2ade267671c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:45.855843 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d53e1-ff66-4198-b01e-2ade267671c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:45.857280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d53e1-ff66-4198-b01e-2ade267671c1 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:45.866938 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9691-1091-488c-9042-f7994fc0e823 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-ef6d53e1-ff66-4198-b01e-2ade267671c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:37:45.876543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:37:45.877464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:37:45.878279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:37:45.878279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:37:45.878279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:37:45.878279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 8/18] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:37:45.883455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d53e1-ff66-4198-b01e-2ade267671c1 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:45.904035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810a0ad-0a81-4730-af99-dac7305dc0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:45.904680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810a0ad-0a81-4730-af99-dac7305dc0ee None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:45.904969 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810a0ad-0a81-4730-af99-dac7305dc0ee None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:45.905250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810a0ad-0a81-4730-af99-dac7305dc0ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:45.906864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810a0ad-0a81-4730-af99-dac7305dc0ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:45.908360 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810a0ad-0a81-4730-af99-dac7305dc0ee None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:45.909907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 11/19] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:37:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:45.916021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810a0ad-0a81-4730-af99-dac7305dc0ee None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:45.942440 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:45.987639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d53e1-ff66-4198-b01e-2ade267671c1 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:45.996565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:46.015378 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810a0ad-0a81-4730-af99-dac7305dc0ee None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:46.021787 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103fce-a879-45ca-b15f-c655db21aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:46.022399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103fce-a879-45ca-b15f-c655db21aa09 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:46.022678 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103fce-a879-45ca-b15f-c655db21aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:46.022969 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103fce-a879-45ca-b15f-c655db21aa09 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:46.023636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103fce-a879-45ca-b15f-c655db21aa09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:37:46.023942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103fce-a879-45ca-b15f-c655db21aa09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:46.025322 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103fce-a879-45ca-b15f-c655db21aa09 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:46.043094 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 9/20] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:46.049224 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391fedd-9f5b-4541-879e-41b7ce7618a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:46.049856 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391fedd-9f5b-4541-879e-41b7ce7618a2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:46.050136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391fedd-9f5b-4541-879e-41b7ce7618a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:46.050409 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391fedd-9f5b-4541-879e-41b7ce7618a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:46.051186 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391fedd-9f5b-4541-879e-41b7ce7618a2 None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.domain.id=default, user.id=eb12f0f56c9240608c4e9af189715bfa) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:37:46.051497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391fedd-9f5b-4541-879e-41b7ce7618a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:46.053016 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391fedd-9f5b-4541-879e-41b7ce7618a2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:46.063890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 12/21] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Oct 3 14:37:45 2022] GET /identity/v3/role_assignments?user.id=eb12f0f56c9240608c4e9af189715bfa&scope.domain.id=default&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:48.784935 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297b334-a7cc-404d-8368-5fb77f358945 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:48.785945 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297b334-a7cc-404d-8368-5fb77f358945 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:48.786427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297b334-a7cc-404d-8368-5fb77f358945 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:48.788404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 10/22] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:48.795366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab755-303b-4e7d-9adf-159dc53b3ae9 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:48.796180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab755-303b-4e7d-9adf-159dc53b3ae9 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:48.796678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ab755-303b-4e7d-9adf-159dc53b3ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:48.819519 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-198ab755-303b-4e7d-9adf-159dc53b3ae9 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:48.821029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-198ab755-303b-4e7d-9adf-159dc53b3ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:48.912895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 13/23] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:37:49.158702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9a92-b792-4737-99c1-1f2a7539dbbe None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:49.159508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9a92-b792-4737-99c1-1f2a7539dbbe None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:49.159988 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d9a92-b792-4737-99c1-1f2a7539dbbe None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:49.161516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 11/24] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:49.167195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabbc1e-f5d2-46a6-b443-29a603852de9 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:49.167710 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabbc1e-f5d2-46a6-b443-29a603852de9 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:49.168197 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabbc1e-f5d2-46a6-b443-29a603852de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:49.189697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-fbabbc1e-f5d2-46a6-b443-29a603852de9 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:49.191217 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-fbabbc1e-f5d2-46a6-b443-29a603852de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:49.292992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 14/25] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:49.404655 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87463d-4585-4623-8eea-9ef125520de8 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:49.405258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87463d-4585-4623-8eea-9ef125520de8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:49.405737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87463d-4585-4623-8eea-9ef125520de8 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:49.407588 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 12/26] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:49.416187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94858b45-6707-495f-9256-1c3024dcf912 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:49.416486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94858b45-6707-495f-9256-1c3024dcf912 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:49.416771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94858b45-6707-495f-9256-1c3024dcf912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:49.426762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:49.440046 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-94858b45-6707-495f-9256-1c3024dcf912 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:49.441518 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-94858b45-6707-495f-9256-1c3024dcf912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:49.471782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87463d-4585-4623-8eea-9ef125520de8 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:49.569700 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 15/27] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:49.573254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cad1a-85a6-4d6a-bf35-c3a020704573 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:49.574409 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cad1a-85a6-4d6a-bf35-c3a020704573 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:49.575501 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cad1a-85a6-4d6a-bf35-c3a020704573 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:49.577100 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 16/28] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:49.592724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa86c9-48e1-4071-add1-6bc55e21190a None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:49.593311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa86c9-48e1-4071-add1-6bc55e21190a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:49.594289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa86c9-48e1-4071-add1-6bc55e21190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:49.619543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-07fa86c9-48e1-4071-add1-6bc55e21190a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:49.622119 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-07fa86c9-48e1-4071-add1-6bc55e21190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:49.664666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87463d-4585-4623-8eea-9ef125520de8 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:49.707301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:49.711244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 17/29] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:49.712669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa86c9-48e1-4071-add1-6bc55e21190a None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:49.767652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ca31b-7f1d-431b-b266-3e8c28e6a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:49.768311 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ca31b-7f1d-431b-b266-3e8c28e6a0cc None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:49.768595 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ca31b-7f1d-431b-b266-3e8c28e6a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:49.768868 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ca31b-7f1d-431b-b266-3e8c28e6a0cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:49.783279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:49.798269 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ca31b-7f1d-431b-b266-3e8c28e6a0cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-e39ca31b-7f1d-431b-b266-3e8c28e6a0cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:37:49.804927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:37:49.805769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:37:49.806538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:37:49.811090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 13/30] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:37:49.812316 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ca31b-7f1d-431b-b266-3e8c28e6a0cc None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:49.828672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa86c9-48e1-4071-add1-6bc55e21190a None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:49.871908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c0423-4536-4204-878f-cb2d06953884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:49.872900 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c0423-4536-4204-878f-cb2d06953884 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:49.873377 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c0423-4536-4204-878f-cb2d06953884 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:49.874027 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c0423-4536-4204-878f-cb2d06953884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:49.894322 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c0423-4536-4204-878f-cb2d06953884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:49.896555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c0423-4536-4204-878f-cb2d06953884 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-321c0423-4536-4204-878f-cb2d06953884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:37:49.914605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:37:49.915669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:37:49.916470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:37:49.916470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:37:49.916470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:37:49.919068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 18/31] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:37:49.920181 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c0423-4536-4204-878f-cb2d06953884 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:49.983742 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ca31b-7f1d-431b-b266-3e8c28e6a0cc None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:50.022242 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79266e-4e44-40af-a75d-96d2b065e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:50.023252 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79266e-4e44-40af-a75d-96d2b065e7cb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.025658 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79266e-4e44-40af-a75d-96d2b065e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.026319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79266e-4e44-40af-a75d-96d2b065e7cb None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.027947 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79266e-4e44-40af-a75d-96d2b065e7cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:37:50.028455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79266e-4e44-40af-a75d-96d2b065e7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:50.030128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79266e-4e44-40af-a75d-96d2b065e7cb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:50.060291 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 14/32] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:37:50.062245 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79266e-4e44-40af-a75d-96d2b065e7cb None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:50.111331 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c0423-4536-4204-878f-cb2d06953884 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:50.122543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:50.135618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:50.162931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2eb95-5424-4057-b048-0c1d27276685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:50.163573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2eb95-5424-4057-b048-0c1d27276685 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.163854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2eb95-5424-4057-b048-0c1d27276685 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.164127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2eb95-5424-4057-b048-0c1d27276685 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.164810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2eb95-5424-4057-b048-0c1d27276685 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:50.166251 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2eb95-5424-4057-b048-0c1d27276685 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:50.200053 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79266e-4e44-40af-a75d-96d2b065e7cb None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:50.241330 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1422e-7fed-4577-8ac8-510ede261e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:50.242390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1422e-7fed-4577-8ac8-510ede261e49 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.242893 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1422e-7fed-4577-8ac8-510ede261e49 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.243385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1422e-7fed-4577-8ac8-510ede261e49 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.244222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1422e-7fed-4577-8ac8-510ede261e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:37:50.244730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1422e-7fed-4577-8ac8-510ede261e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:50.246575 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1422e-7fed-4577-8ac8-510ede261e49 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:50.261837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 15/33] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:37:50.263150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1422e-7fed-4577-8ac8-510ede261e49 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:50.310530 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 19/34] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Oct 3 14:37:49 2022] POST /identity/v3/roles => generated 219 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:37:50.311493 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2eb95-5424-4057-b048-0c1d27276685 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:50.369449 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:50.374015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1422e-7fed-4577-8ac8-510ede261e49 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:50.414340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25de57-a744-4cd6-8d97-0b737832075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:50.415344 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25de57-a744-4cd6-8d97-0b737832075a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.415622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25de57-a744-4cd6-8d97-0b737832075a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.415898 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25de57-a744-4cd6-8d97-0b737832075a None admin] PATH_INFO: `/v3/users/eb12f0f56c9240608c4e9af189715bfa` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.417535 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25de57-a744-4cd6-8d97-0b737832075a None admin] RBAC: Authorizing `identity:get_user(user_id=eb12f0f56c9240608c4e9af189715bfa)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:50.419052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25de57-a744-4cd6-8d97-0b737832075a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:50.425722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 16/35] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:37:50 2022] GET /identity/v3/users/eb12f0f56c9240608c4e9af189715bfa => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:37:50.425722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25de57-a744-4cd6-8d97-0b737832075a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:50.468080 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2eb95-5424-4057-b048-0c1d27276685 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:50.521045 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8824f6-ae58-4bfa-b8ce-58b03f8c2706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:50.522118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8824f6-ae58-4bfa-b8ce-58b03f8c2706 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.523240 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8824f6-ae58-4bfa-b8ce-58b03f8c2706 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.523735 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8824f6-ae58-4bfa-b8ce-58b03f8c2706 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.524906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8824f6-ae58-4bfa-b8ce-58b03f8c2706 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:50.527469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8824f6-ae58-4bfa-b8ce-58b03f8c2706 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:50.535911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25de57-a744-4cd6-8d97-0b737832075a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:50.557674 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 20/36] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Oct 3 14:37:50 2022] POST /identity/v3/roles => generated 225 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:37:50.559410 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88909-367c-4279-98f9-22d283fc468e None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.559699 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88909-367c-4279-98f9-22d283fc468e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.559984 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a88909-367c-4279-98f9-22d283fc468e None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.561587 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 21/37] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:50.562259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a88909-367c-4279-98f9-22d283fc468e None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:50.586090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c213f5-56b6-4378-82fb-a8e46dcb9611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:50.586814 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c213f5-56b6-4378-82fb-a8e46dcb9611 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.587143 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c213f5-56b6-4378-82fb-a8e46dcb9611 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.587427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c213f5-56b6-4378-82fb-a8e46dcb9611 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.588120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c213f5-56b6-4378-82fb-a8e46dcb9611 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:50.592432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c213f5-56b6-4378-82fb-a8e46dcb9611 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:50.732720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:50.751000 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 17/38] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:37:50 2022] POST /identity/v3/projects => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:37:50.754496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07928d99-7088-4224-8fc0-72b31203a5b4 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.754496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07928d99-7088-4224-8fc0-72b31203a5b4 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.754496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07928d99-7088-4224-8fc0-72b31203a5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.775586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-07928d99-7088-4224-8fc0-72b31203a5b4 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:50.777420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-07928d99-7088-4224-8fc0-72b31203a5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:50.794351 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:50.849865 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a88909-367c-4279-98f9-22d283fc468e None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:50.878583 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 18/39] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:50.879942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259192-daf1-4456-a121-3f3c3f14ab60 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.880231 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259192-daf1-4456-a121-3f3c3f14ab60 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.880508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259192-daf1-4456-a121-3f3c3f14ab60 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.881923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 19/40] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:50.887575 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed242ec-0b4c-4754-a026-ab4dc23bdacf None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.887860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed242ec-0b4c-4754-a026-ab4dc23bdacf None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.888137 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed242ec-0b4c-4754-a026-ab4dc23bdacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.900356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690435d-e6d2-4ee4-9a7e-1328fc9bec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:50.901446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690435d-e6d2-4ee4-9a7e-1328fc9bec51 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:50.901944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690435d-e6d2-4ee4-9a7e-1328fc9bec51 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:50.902428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690435d-e6d2-4ee4-9a7e-1328fc9bec51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:50.904035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690435d-e6d2-4ee4-9a7e-1328fc9bec51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:50.905825 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690435d-e6d2-4ee4-9a7e-1328fc9bec51 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:50.908435 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 22/41] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:37:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:37:50.911398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-8ed242ec-0b4c-4754-a026-ab4dc23bdacf None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:50.912977 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-8ed242ec-0b4c-4754-a026-ab4dc23bdacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:50.916001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690435d-e6d2-4ee4-9a7e-1328fc9bec51 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:50.998465 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 20/42] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:51.034640 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690435d-e6d2-4ee4-9a7e-1328fc9bec51 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:51.037835 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:51.072282 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465f54-e81d-4238-8895-c26edd6bd6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:51.072955 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465f54-e81d-4238-8895-c26edd6bd6c6 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:51.073246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465f54-e81d-4238-8895-c26edd6bd6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:51.073528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b465f54-e81d-4238-8895-c26edd6bd6c6 None admin] PATH_INFO: `/v3/domains/default/users/eb12f0f56c9240608c4e9af189715bfa/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:51.075463 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465f54-e81d-4238-8895-c26edd6bd6c6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eb12f0f56c9240608c4e9af189715bfa, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:51.076904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b465f54-e81d-4238-8895-c26edd6bd6c6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:51.095709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 23/43] 10.222.0.39 () {58 vars in 1361 bytes} [Mon Oct 3 14:37:50 2022] PUT /identity/v3/domains/default/users/eb12f0f56c9240608c4e9af189715bfa/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:37:51.170198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed242ec-0b4c-4754-a026-ab4dc23bdacf None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:51.257629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:51.283198 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465f54-e81d-4238-8895-c26edd6bd6c6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:51.284013 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed242ec-0b4c-4754-a026-ab4dc23bdacf None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:51.321830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df55e1-6f12-457b-b301-ec1582009296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:51.322451 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df55e1-6f12-457b-b301-ec1582009296 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:51.322731 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df55e1-6f12-457b-b301-ec1582009296 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:51.323034 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df55e1-6f12-457b-b301-ec1582009296 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:51.323716 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df55e1-6f12-457b-b301-ec1582009296 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:51.325207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df55e1-6f12-457b-b301-ec1582009296 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:51.342320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 21/44] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Oct 3 14:37:51 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:37:51.398166 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b465f54-e81d-4238-8895-c26edd6bd6c6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:51.437191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64528a7-a681-4aca-8850-4f93992955b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:51.437877 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64528a7-a681-4aca-8850-4f93992955b1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:51.438165 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64528a7-a681-4aca-8850-4f93992955b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:51.438442 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64528a7-a681-4aca-8850-4f93992955b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:51.439648 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64528a7-a681-4aca-8850-4f93992955b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:51.441140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64528a7-a681-4aca-8850-4f93992955b1 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:51.442988 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 24/45] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:37:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:51.448498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df55e1-6f12-457b-b301-ec1582009296 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:51.560259 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df55e1-6f12-457b-b301-ec1582009296 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:51.597134 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb1b64-750a-4363-91e7-9eb49abffb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:51.597791 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1b64-750a-4363-91e7-9eb49abffb3d None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:51.598077 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1b64-750a-4363-91e7-9eb49abffb3d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:51.598358 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1b64-750a-4363-91e7-9eb49abffb3d None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:51.599171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb1b64-750a-4363-91e7-9eb49abffb3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:51.600634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb1b64-750a-4363-91e7-9eb49abffb3d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:51.610760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:51.629761 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 22/46] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:37:51 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:37:53.298597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26df4-3efd-4a7f-aa24-ca4563181e05 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:53.299130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26df4-3efd-4a7f-aa24-ca4563181e05 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:53.299213 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be26df4-3efd-4a7f-aa24-ca4563181e05 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:53.300539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 25/47] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:53.306011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770105c1-6376-4f8a-a33b-8ba3a5dbac8f None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:53.306442 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770105c1-6376-4f8a-a33b-8ba3a5dbac8f None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:53.306578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770105c1-6376-4f8a-a33b-8ba3a5dbac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:53.325412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-770105c1-6376-4f8a-a33b-8ba3a5dbac8f None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:53.326884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-770105c1-6376-4f8a-a33b-8ba3a5dbac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:53.393971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 23/48] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:53.663872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be26df4-3efd-4a7f-aa24-ca4563181e05 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:53.698119 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:53.767120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a0932-d30d-4993-b264-602e31a0ab1e None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:53.767524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a0932-d30d-4993-b264-602e31a0ab1e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:53.767884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a0932-d30d-4993-b264-602e31a0ab1e None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:53.769229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 24/49] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:37:53.771265 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be26df4-3efd-4a7f-aa24-ca4563181e05 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:53.775026 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286917ae-b938-4840-a687-0657a29ec717 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:53.775308 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286917ae-b938-4840-a687-0657a29ec717 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:53.775583 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286917ae-b938-4840-a687-0657a29ec717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:53.795258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-286917ae-b938-4840-a687-0657a29ec717 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:53.796451 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-286917ae-b938-4840-a687-0657a29ec717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:53.804942 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9698b90-0af6-4ea1-91aa-d8152e5c3bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:53.805580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9698b90-0af6-4ea1-91aa-d8152e5c3bb9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:53.805875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9698b90-0af6-4ea1-91aa-d8152e5c3bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:53.806160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9698b90-0af6-4ea1-91aa-d8152e5c3bb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:53.816459 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9698b90-0af6-4ea1-91aa-d8152e5c3bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e9698b90-0af6-4ea1-91aa-d8152e5c3bb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:37:53.821283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:37:53.822140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:37:53.822895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 26/50] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:37:53.828831 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9698b90-0af6-4ea1-91aa-d8152e5c3bb9 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:53.924088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:53.933093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9698b90-0af6-4ea1-91aa-d8152e5c3bb9 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:53.967625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae0f1-b6f7-40ae-b628-1ac6efada059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:53.968229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae0f1-b6f7-40ae-b628-1ac6efada059 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:53.968513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae0f1-b6f7-40ae-b628-1ac6efada059 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:53.968835 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae0f1-b6f7-40ae-b628-1ac6efada059 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:53.969487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 25/51] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:37:53.970371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdae0f1-b6f7-40ae-b628-1ac6efada059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:37:53.970678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdae0f1-b6f7-40ae-b628-1ac6efada059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:53.972086 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdae0f1-b6f7-40ae-b628-1ac6efada059 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:53.981915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 27/52] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:37:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:53.987466 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286917ae-b938-4840-a687-0657a29ec717 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:54.037311 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:54.087505 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286917ae-b938-4840-a687-0657a29ec717 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:54.122483 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6f660-7f8d-4117-bd03-6fa554a2006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:54.123149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6f660-7f8d-4117-bd03-6fa554a2006f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:54.123433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6f660-7f8d-4117-bd03-6fa554a2006f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:54.123705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6f660-7f8d-4117-bd03-6fa554a2006f None admin] PATH_INFO: `/v3/users/eb12f0f56c9240608c4e9af189715bfa` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:54.124810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6f660-7f8d-4117-bd03-6fa554a2006f None admin] RBAC: Authorizing `identity:get_user(user_id=eb12f0f56c9240608c4e9af189715bfa)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:54.126399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6f660-7f8d-4117-bd03-6fa554a2006f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:54.128002 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:37:53 2022] GET /identity/v3/users/eb12f0f56c9240608c4e9af189715bfa => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:54.133591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae0f1-b6f7-40ae-b628-1ac6efada059 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:54.229611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae0f1-b6f7-40ae-b628-1ac6efada059 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:54.244178 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6f660-7f8d-4117-bd03-6fa554a2006f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:54.262637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156edd26-8e51-4a58-be1c-85cfcf79f341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:54.263316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156edd26-8e51-4a58-be1c-85cfcf79f341 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:54.263606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156edd26-8e51-4a58-be1c-85cfcf79f341 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:54.263888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156edd26-8e51-4a58-be1c-85cfcf79f341 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:54.265002 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156edd26-8e51-4a58-be1c-85cfcf79f341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:54.266758 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156edd26-8e51-4a58-be1c-85cfcf79f341 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:54.268375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 28/54] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:54.274299 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156edd26-8e51-4a58-be1c-85cfcf79f341 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:54.299608 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:54.349536 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6f660-7f8d-4117-bd03-6fa554a2006f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:54.367416 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:54.379465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156edd26-8e51-4a58-be1c-85cfcf79f341 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:54.385485 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b21b4-4eb7-42e0-90c3-9f95b63de2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:54.386118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b21b4-4eb7-42e0-90c3-9f95b63de2c6 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:54.386400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b21b4-4eb7-42e0-90c3-9f95b63de2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:54.386679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b21b4-4eb7-42e0-90c3-9f95b63de2c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:54.387809 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b21b4-4eb7-42e0-90c3-9f95b63de2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:54.389240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b21b4-4eb7-42e0-90c3-9f95b63de2c6 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:54.391609 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:54.396970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b21b4-4eb7-42e0-90c3-9f95b63de2c6 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:54.415013 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df4749-1110-488f-a3cf-e7c78d09552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:54.415637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4749-1110-488f-a3cf-e7c78d09552c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:54.415920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4749-1110-488f-a3cf-e7c78d09552c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:54.416205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df4749-1110-488f-a3cf-e7c78d09552c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:54.416922 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df4749-1110-488f-a3cf-e7c78d09552c None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.domain.id=default, user.id=eb12f0f56c9240608c4e9af189715bfa) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:37:54.417234 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df4749-1110-488f-a3cf-e7c78d09552c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:54.418669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df4749-1110-488f-a3cf-e7c78d09552c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:54.425029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 29/56] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Oct 3 14:37:54 2022] GET /identity/v3/role_assignments?user.id=eb12f0f56c9240608c4e9af189715bfa&scope.domain.id=default&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:37:54.504990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b21b4-4eb7-42e0-90c3-9f95b63de2c6 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:54.541528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200f814-6eeb-4877-bcc7-ca9e92fdedda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:54.542154 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200f814-6eeb-4877-bcc7-ca9e92fdedda None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:54.542441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200f814-6eeb-4877-bcc7-ca9e92fdedda None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:54.542722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200f814-6eeb-4877-bcc7-ca9e92fdedda None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:54.543428 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200f814-6eeb-4877-bcc7-ca9e92fdedda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:54.544894 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200f814-6eeb-4877-bcc7-ca9e92fdedda None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:54.574146 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 28/57] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Oct 3 14:37:54 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 14:37:56.733447 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad8aa8-eebc-4290-b6de-39ee9fec9557 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:56.733963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad8aa8-eebc-4290-b6de-39ee9fec9557 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:56.734067 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad8aa8-eebc-4290-b6de-39ee9fec9557 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:56.735521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 30/58] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:37:56.741007 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867391c-0a70-4bec-8308-77b46c5ea24d None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:56.741430 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867391c-0a70-4bec-8308-77b46c5ea24d None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:56.741915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867391c-0a70-4bec-8308-77b46c5ea24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:56.760127 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-4867391c-0a70-4bec-8308-77b46c5ea24d None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:37:56.761302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-4867391c-0a70-4bec-8308-77b46c5ea24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:37:56.790551 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:56.827473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:37:57.096479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad8aa8-eebc-4290-b6de-39ee9fec9557 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:57.180199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:37:57.195925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad8aa8-eebc-4290-b6de-39ee9fec9557 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:57.229187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ded877-b1ff-4668-95f2-d6b964c4dde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:57.229814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ded877-b1ff-4668-95f2-d6b964c4dde2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:57.230102 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ded877-b1ff-4668-95f2-d6b964c4dde2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:57.230384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ded877-b1ff-4668-95f2-d6b964c4dde2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:57.231508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ded877-b1ff-4668-95f2-d6b964c4dde2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:57.232986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ded877-b1ff-4668-95f2-d6b964c4dde2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:57.235269 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 31/60] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:37:57.240793 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867391c-0a70-4bec-8308-77b46c5ea24d None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:37:57.335357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867391c-0a70-4bec-8308-77b46c5ea24d None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:37:57.368962 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df5650-84ce-4929-ba23-f248e8b21ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:37:57.369496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5650-84ce-4929-ba23-f248e8b21ba7 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:37:57.369780 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5650-84ce-4929-ba23-f248e8b21ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:37:57.370055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5650-84ce-4929-ba23-f248e8b21ba7 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:37:57.370993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df5650-84ce-4929-ba23-f248e8b21ba7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:37:57.372439 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df5650-84ce-4929-ba23-f248e8b21ba7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:37:57.398840 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:37:57 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 14:38:00.672944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969fca-961b-4ff3-b548-17616d3558bf None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:00.673450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969fca-961b-4ff3-b548-17616d3558bf None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:00.673556 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e969fca-961b-4ff3-b548-17616d3558bf None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:00.675001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 32/62] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:00.685733 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1c8c-d139-4c2a-9995-012f406d23f4 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:00.686191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1c8c-d139-4c2a-9995-012f406d23f4 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:00.686291 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1c8c-d139-4c2a-9995-012f406d23f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:00.716212 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-51fc1c8c-d139-4c2a-9995-012f406d23f4 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:00.717734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-51fc1c8c-d139-4c2a-9995-012f406d23f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:00.738737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:00.804177 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:00.905322 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e427-6199-4e44-97b1-683a364cdada None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:00.905971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e427-6199-4e44-97b1-683a364cdada None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:00.907297 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5e427-6199-4e44-97b1-683a364cdada None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:00.909206 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 33/64] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:00.914281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18a577-8f8d-45e6-a91e-1cbfb646da22 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:00.914573 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18a577-8f8d-45e6-a91e-1cbfb646da22 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:00.914855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18a577-8f8d-45e6-a91e-1cbfb646da22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:00.942673 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-9b18a577-8f8d-45e6-a91e-1cbfb646da22 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:00.943859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-9b18a577-8f8d-45e6-a91e-1cbfb646da22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:01.015574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e49ea-a64c-466f-91d9-9713a003c084 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.016267 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e49ea-a64c-466f-91d9-9713a003c084 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.016744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e49ea-a64c-466f-91d9-9713a003c084 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.018558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 34/65] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:01.028884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85fc06-1c9c-4a4c-84a7-5267327be924 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.029296 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 32/66] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:01.029789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85fc06-1c9c-4a4c-84a7-5267327be924 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.030333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85fc06-1c9c-4a4c-84a7-5267327be924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.067944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-5a85fc06-1c9c-4a4c-84a7-5267327be924 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:01.069820 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-5a85fc06-1c9c-4a4c-84a7-5267327be924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:01.133794 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18a577-8f8d-45e6-a91e-1cbfb646da22 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:01.200603 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 35/67] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:01.256188 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:01.276800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18a577-8f8d-45e6-a91e-1cbfb646da22 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:01.315355 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda6f3c-fc68-482d-a02e-c224d8f6c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:01.315686 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e283a0-427f-4cc9-bf6e-fa1d4fb33554 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.316203 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e283a0-427f-4cc9-bf6e-fa1d4fb33554 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.316405 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda6f3c-fc68-482d-a02e-c224d8f6c57e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.316491 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda6f3c-fc68-482d-a02e-c224d8f6c57e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.316762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda6f3c-fc68-482d-a02e-c224d8f6c57e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.317175 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e283a0-427f-4cc9-bf6e-fa1d4fb33554 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.318712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 36/68] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:01.324018 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017ff9-ff25-4685-8eee-7c6bab05878e None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.324834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017ff9-ff25-4685-8eee-7c6bab05878e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.325356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017ff9-ff25-4685-8eee-7c6bab05878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.342985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda6f3c-fc68-482d-a02e-c224d8f6c57e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-0eda6f3c-fc68-482d-a02e-c224d8f6c57e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:01.346235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:01.347103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:01.347872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 33/69] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:01.355207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda6f3c-fc68-482d-a02e-c224d8f6c57e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:01.367516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-16017ff9-ff25-4685-8eee-7c6bab05878e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:01.368755 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-16017ff9-ff25-4685-8eee-7c6bab05878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:01.469892 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 37/70] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:01.471223 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017ff9-ff25-4685-8eee-7c6bab05878e None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:01.472400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda6f3c-fc68-482d-a02e-c224d8f6c57e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:01.489998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:01.526182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdba837-c6b9-4ea7-8a30-ee5fba6a1f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:01.527218 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdba837-c6b9-4ea7-8a30-ee5fba6a1f7f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.527695 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdba837-c6b9-4ea7-8a30-ee5fba6a1f7f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.528175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdba837-c6b9-4ea7-8a30-ee5fba6a1f7f None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.528847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdba837-c6b9-4ea7-8a30-ee5fba6a1f7f None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:01.529150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdba837-c6b9-4ea7-8a30-ee5fba6a1f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:01.530529 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdba837-c6b9-4ea7-8a30-ee5fba6a1f7f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:01.539576 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 34/71] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:01.540215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdba837-c6b9-4ea7-8a30-ee5fba6a1f7f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:01.550385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:01.598352 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017ff9-ff25-4685-8eee-7c6bab05878e None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:01.644416 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e2b77-bce7-4def-b5fa-c53f575a80ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:01.645066 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e2b77-bce7-4def-b5fa-c53f575a80ff None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.645357 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e2b77-bce7-4def-b5fa-c53f575a80ff None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.645641 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e2b77-bce7-4def-b5fa-c53f575a80ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.651479 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdba837-c6b9-4ea7-8a30-ee5fba6a1f7f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:01.660965 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e2b77-bce7-4def-b5fa-c53f575a80ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-953e2b77-bce7-4def-b5fa-c53f575a80ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:01.665887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:01.666765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:01.667548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 38/72] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:38:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:01.668783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e48e-3bde-40cc-ad5e-5e7c292157d5 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.668985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e48e-3bde-40cc-ad5e-5e7c292157d5 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.669261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e48e-3bde-40cc-ad5e-5e7c292157d5 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.670649 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 39/73] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:01.676221 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e48e-3bde-40cc-ad5e-5e7c292157d5 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:01.696924 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366e664-c49c-4c6c-b30d-ea664fafa02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:01.697843 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366e664-c49c-4c6c-b30d-ea664fafa02a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.698288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366e664-c49c-4c6c-b30d-ea664fafa02a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.699222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366e664-c49c-4c6c-b30d-ea664fafa02a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.712510 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366e664-c49c-4c6c-b30d-ea664fafa02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-e366e664-c49c-4c6c-b30d-ea664fafa02a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:01.719849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:01.720756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:01.721538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 35/74] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:01.723106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366e664-c49c-4c6c-b30d-ea664fafa02a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:01.761865 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:01.789655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e48e-3bde-40cc-ad5e-5e7c292157d5 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:01.793471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:01.822572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3f1e3-174f-454d-aad3-f447a68462ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:01.823238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3f1e3-174f-454d-aad3-f447a68462ae None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.823524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3f1e3-174f-454d-aad3-f447a68462ae None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.823803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3f1e3-174f-454d-aad3-f447a68462ae None admin] PATH_INFO: `/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.828688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366e664-c49c-4c6c-b30d-ea664fafa02a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:01.836680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3f1e3-174f-454d-aad3-f447a68462ae None admin] RBAC: Authorizing `identity:get_user(user_id=c23d5a581fbf45b78bcf03fdbfb9ff89)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:01.838133 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3f1e3-174f-454d-aad3-f447a68462ae None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:01.839770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 40/75] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:01 2022] GET /identity/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:01.840903 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8ee3-f4bc-438c-b6b4-e83f528cf37b None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.841189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8ee3-f4bc-438c-b6b4-e83f528cf37b None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.841466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8ee3-f4bc-438c-b6b4-e83f528cf37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.860287 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-de7e8ee3-f4bc-438c-b6b4-e83f528cf37b None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:01.861430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-de7e8ee3-f4bc-438c-b6b4-e83f528cf37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:01.867335 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5738e1c-9ee7-4b38-8881-ebc5662ec1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:01.867949 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738e1c-9ee7-4b38-8881-ebc5662ec1f7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:01.868236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738e1c-9ee7-4b38-8881-ebc5662ec1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:01.868521 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738e1c-9ee7-4b38-8881-ebc5662ec1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:01.869181 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5738e1c-9ee7-4b38-8881-ebc5662ec1f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:01.869487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5738e1c-9ee7-4b38-8881-ebc5662ec1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:01.871148 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5738e1c-9ee7-4b38-8881-ebc5662ec1f7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:01.879545 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 36/76] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:01.880332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5738e1c-9ee7-4b38-8881-ebc5662ec1f7 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:01.927275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 41/77] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:01.928129 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8ee3-f4bc-438c-b6b4-e83f528cf37b None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:01.991862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:01.998397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5738e1c-9ee7-4b38-8881-ebc5662ec1f7 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.026885 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.035052 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8ee3-f4bc-438c-b6b4-e83f528cf37b None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.036590 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70201fa9-f70d-4466-adcb-d8bdaa8ff61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.038258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70201fa9-f70d-4466-adcb-d8bdaa8ff61f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.038258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70201fa9-f70d-4466-adcb-d8bdaa8ff61f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.038258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70201fa9-f70d-4466-adcb-d8bdaa8ff61f None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.038508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70201fa9-f70d-4466-adcb-d8bdaa8ff61f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:02.038745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70201fa9-f70d-4466-adcb-d8bdaa8ff61f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.040153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70201fa9-f70d-4466-adcb-d8bdaa8ff61f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.053303 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 37/78] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:02.053303 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70201fa9-f70d-4466-adcb-d8bdaa8ff61f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:02.083726 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99cbd2-538f-4e32-a8a2-dff98c5ece1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.084372 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99cbd2-538f-4e32-a8a2-dff98c5ece1d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.084659 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99cbd2-538f-4e32-a8a2-dff98c5ece1d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.084941 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99cbd2-538f-4e32-a8a2-dff98c5ece1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.096571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99cbd2-538f-4e32-a8a2-dff98c5ece1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-4b99cbd2-538f-4e32-a8a2-dff98c5ece1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:02.101579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:02.102417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 42/79] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:02.103918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99cbd2-538f-4e32-a8a2-dff98c5ece1d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:02.167779 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70201fa9-f70d-4466-adcb-d8bdaa8ff61f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.202366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296342ca-2166-4f00-95c8-12b7af02f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.203548 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296342ca-2166-4f00-95c8-12b7af02f68f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.203838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296342ca-2166-4f00-95c8-12b7af02f68f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.204114 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296342ca-2166-4f00-95c8-12b7af02f68f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.205233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99cbd2-538f-4e32-a8a2-dff98c5ece1d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.226895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.238907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500ffaa-c1b7-4621-bff7-82995c6b5433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.239569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500ffaa-c1b7-4621-bff7-82995c6b5433 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.239856 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500ffaa-c1b7-4621-bff7-82995c6b5433 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.240136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500ffaa-c1b7-4621-bff7-82995c6b5433 None admin] PATH_INFO: `/v3/users/eb12f0f56c9240608c4e9af189715bfa` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.241266 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500ffaa-c1b7-4621-bff7-82995c6b5433 None admin] RBAC: Authorizing `identity:get_user(user_id=eb12f0f56c9240608c4e9af189715bfa)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.242765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500ffaa-c1b7-4621-bff7-82995c6b5433 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.244327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 43/80] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/users/eb12f0f56c9240608c4e9af189715bfa => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:02.245086 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500ffaa-c1b7-4621-bff7-82995c6b5433 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:02.263708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.275283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296342ca-2166-4f00-95c8-12b7af02f68f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.276771 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296342ca-2166-4f00-95c8-12b7af02f68f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.341850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500ffaa-c1b7-4621-bff7-82995c6b5433 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.374151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051071e-a803-4b57-afdd-7cbac9fef765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.374439 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 38/81] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:02.375342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051071e-a803-4b57-afdd-7cbac9fef765 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.375633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051071e-a803-4b57-afdd-7cbac9fef765 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.375910 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051071e-a803-4b57-afdd-7cbac9fef765 None admin] PATH_INFO: `/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.376175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296342ca-2166-4f00-95c8-12b7af02f68f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:02.377041 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051071e-a803-4b57-afdd-7cbac9fef765 None admin] RBAC: Authorizing `identity:get_user(user_id=c23d5a581fbf45b78bcf03fdbfb9ff89)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.378464 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051071e-a803-4b57-afdd-7cbac9fef765 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.380058 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 44/82] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:02.380854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051071e-a803-4b57-afdd-7cbac9fef765 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:02.441290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.467727 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.478682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296342ca-2166-4f00-95c8-12b7af02f68f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.482060 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051071e-a803-4b57-afdd-7cbac9fef765 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.512223 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a4848-9a97-4b10-a551-d2725eb685c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.512762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a4848-9a97-4b10-a551-d2725eb685c2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.513043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a4848-9a97-4b10-a551-d2725eb685c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.513317 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a4848-9a97-4b10-a551-d2725eb685c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.513965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a4848-9a97-4b10-a551-d2725eb685c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:02.514272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a4848-9a97-4b10-a551-d2725eb685c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.515047 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f88c4-27ca-4dff-9ca8-53d2c99235d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.515816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a4848-9a97-4b10-a551-d2725eb685c2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.515904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f88c4-27ca-4dff-9ca8-53d2c99235d0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.516098 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f88c4-27ca-4dff-9ca8-53d2c99235d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.516373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f88c4-27ca-4dff-9ca8-53d2c99235d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.517467 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f88c4-27ca-4dff-9ca8-53d2c99235d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.518895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f88c4-27ca-4dff-9ca8-53d2c99235d0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.520488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 45/83] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:02.523090 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f88c4-27ca-4dff-9ca8-53d2c99235d0 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:02.526448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 39/84] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:02.527308 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a4848-9a97-4b10-a551-d2725eb685c2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:02.621672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f88c4-27ca-4dff-9ca8-53d2c99235d0 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.626289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a4848-9a97-4b10-a551-d2725eb685c2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.646104 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.655660 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5af7-85eb-462e-aa27-f0fde4e0cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.656971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5af7-85eb-462e-aa27-f0fde4e0cc4d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.657257 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5af7-85eb-462e-aa27-f0fde4e0cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.657684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5af7-85eb-462e-aa27-f0fde4e0cc4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.660721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad71a5-4934-4555-808a-e97990b9d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.661352 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad71a5-4934-4555-808a-e97990b9d894 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.661639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad71a5-4934-4555-808a-e97990b9d894 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.661920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad71a5-4934-4555-808a-e97990b9d894 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.663101 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad71a5-4934-4555-808a-e97990b9d894 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.664554 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad71a5-4934-4555-808a-e97990b9d894 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.666183 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 40/85] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:02.666964 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad71a5-4934-4555-808a-e97990b9d894 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:02.689003 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.729521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae5af7-85eb-462e-aa27-f0fde4e0cc4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.731012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae5af7-85eb-462e-aa27-f0fde4e0cc4d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.768032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad71a5-4934-4555-808a-e97990b9d894 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.802493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cf441-8593-4d14-a372-41eefdb34350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.803139 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cf441-8593-4d14-a372-41eefdb34350 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.803419 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cf441-8593-4d14-a372-41eefdb34350 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.803690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cf441-8593-4d14-a372-41eefdb34350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.828094 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 46/86] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:02.828999 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5af7-85eb-462e-aa27-f0fde4e0cc4d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:02.853941 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.877614 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cf441-8593-4d14-a372-41eefdb34350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.879117 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cf441-8593-4d14-a372-41eefdb34350 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.900323 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:02.924750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5af7-85eb-462e-aa27-f0fde4e0cc4d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:02.958750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c835aa-c6b9-45cd-bcbd-d81aef5ea524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:02.959463 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c835aa-c6b9-45cd-bcbd-d81aef5ea524 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:02.959811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c835aa-c6b9-45cd-bcbd-d81aef5ea524 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:02.960093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c835aa-c6b9-45cd-bcbd-d81aef5ea524 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:02.960740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c835aa-c6b9-45cd-bcbd-d81aef5ea524 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:02.962189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c835aa-c6b9-45cd-bcbd-d81aef5ea524 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:02.979743 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 41/87] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:02.980596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cf441-8593-4d14-a372-41eefdb34350 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:03.006978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 47/88] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:02 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:03.006978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c835aa-c6b9-45cd-bcbd-d81aef5ea524 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:03.099225 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cf441-8593-4d14-a372-41eefdb34350 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:03.112586 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:03.122486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:03.136357 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c835aa-c6b9-45cd-bcbd-d81aef5ea524 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:03.143245 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d24da-afa3-449a-bfa4-5bf07cd1d7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:03.143905 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d24da-afa3-449a-bfa4-5bf07cd1d7cd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:03.144191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d24da-afa3-449a-bfa4-5bf07cd1d7cd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:03.144468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d24da-afa3-449a-bfa4-5bf07cd1d7cd None admin] PATH_INFO: `/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:03.145648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d24da-afa3-449a-bfa4-5bf07cd1d7cd None admin] RBAC: Authorizing `identity:get_user(user_id=c23d5a581fbf45b78bcf03fdbfb9ff89)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:03.147163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d24da-afa3-449a-bfa4-5bf07cd1d7cd None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:03.148810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 42/89] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:03.154219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d24da-afa3-449a-bfa4-5bf07cd1d7cd None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:03.176813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216731e3-0379-418b-a1c8-6bfdef2d4d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:03.177433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216731e3-0379-418b-a1c8-6bfdef2d4d95 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:03.177713 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216731e3-0379-418b-a1c8-6bfdef2d4d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:03.177991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216731e3-0379-418b-a1c8-6bfdef2d4d95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:03.178713 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216731e3-0379-418b-a1c8-6bfdef2d4d95 None admin] RBAC: Adding query filter params (role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a, user.id=c23d5a581fbf45b78bcf03fdbfb9ff89) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:03.179063 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216731e3-0379-418b-a1c8-6bfdef2d4d95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:03.180511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216731e3-0379-418b-a1c8-6bfdef2d4d95 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:03.188375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 48/90] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:02 2022] GET /identity/v3/role_assignments?user.id=c23d5a581fbf45b78bcf03fdbfb9ff89&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:03.189281 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216731e3-0379-418b-a1c8-6bfdef2d4d95 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:03.288276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d24da-afa3-449a-bfa4-5bf07cd1d7cd None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:03.327413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216731e3-0379-418b-a1c8-6bfdef2d4d95 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:03.333537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b821e96-453b-4d15-aed1-68f90b0a005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:03.334537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b821e96-453b-4d15-aed1-68f90b0a005f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:03.335035 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b821e96-453b-4d15-aed1-68f90b0a005f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:03.335558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b821e96-453b-4d15-aed1-68f90b0a005f None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:03.337025 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b821e96-453b-4d15-aed1-68f90b0a005f None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:03.338691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b821e96-453b-4d15-aed1-68f90b0a005f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:03.341077 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 43/91] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:03 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:03.346701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b821e96-453b-4d15-aed1-68f90b0a005f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:03.379684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84db3-f435-4297-a84e-0f41c4825110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:03.380467 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84db3-f435-4297-a84e-0f41c4825110 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:03.380748 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84db3-f435-4297-a84e-0f41c4825110 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:03.381024 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c84db3-f435-4297-a84e-0f41c4825110 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:03.382159 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c84db3-f435-4297-a84e-0f41c4825110 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:03.384406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c84db3-f435-4297-a84e-0f41c4825110 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:03.386065 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 49/92] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:03 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:03.386838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84db3-f435-4297-a84e-0f41c4825110 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:03.407439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:03.424865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:03.491160 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b821e96-453b-4d15-aed1-68f90b0a005f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:03.508926 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c84db3-f435-4297-a84e-0f41c4825110 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:03.549341 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbc811-6bd7-4ad2-8b6f-7e32966fcc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:03.549953 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbc811-6bd7-4ad2-8b6f-7e32966fcc57 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:03.550232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbc811-6bd7-4ad2-8b6f-7e32966fcc57 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:03.550504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbc811-6bd7-4ad2-8b6f-7e32966fcc57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:03.567751 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc0a6f-b78b-423b-80c1-f789e7223316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:03.568374 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc0a6f-b78b-423b-80c1-f789e7223316 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:03.568656 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc0a6f-b78b-423b-80c1-f789e7223316 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:03.568934 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc0a6f-b78b-423b-80c1-f789e7223316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:03.569662 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc0a6f-b78b-423b-80c1-f789e7223316 None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a, user.id=eb12f0f56c9240608c4e9af189715bfa) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:03.569971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc0a6f-b78b-423b-80c1-f789e7223316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:03.571461 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc0a6f-b78b-423b-80c1-f789e7223316 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:03.577398 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 50/93] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:03 2022] GET /identity/v3/role_assignments?user.id=eb12f0f56c9240608c4e9af189715bfa&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:03.578811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc0a6f-b78b-423b-80c1-f789e7223316 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:03.695790 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbc811-6bd7-4ad2-8b6f-7e32966fcc57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:03.697198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbc811-6bd7-4ad2-8b6f-7e32966fcc57 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:03.760864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:03.761435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:03.812016 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 44/94] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:03.818179 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbc811-6bd7-4ad2-8b6f-7e32966fcc57 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:03.836955 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc0a6f-b78b-423b-80c1-f789e7223316 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:03.925116 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbc811-6bd7-4ad2-8b6f-7e32966fcc57 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:03.927126 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cdecb-1cef-402c-b7a6-ab9c4fa6809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:03.927911 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cdecb-1cef-402c-b7a6-ab9c4fa6809a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:03.928203 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cdecb-1cef-402c-b7a6-ab9c4fa6809a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:03.928489 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cdecb-1cef-402c-b7a6-ab9c4fa6809a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:03.929235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cdecb-1cef-402c-b7a6-ab9c4fa6809a None admin] RBAC: Adding query filter params (role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a, user.id=c23d5a581fbf45b78bcf03fdbfb9ff89) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:03.929553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cdecb-1cef-402c-b7a6-ab9c4fa6809a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:03.931030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304cdecb-1cef-402c-b7a6-ab9c4fa6809a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:03.946001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 51/95] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:03 2022] GET /identity/v3/role_assignments?user.id=c23d5a581fbf45b78bcf03fdbfb9ff89&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:03.961279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea775c-7ba2-40dd-897c-0a271413af96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:03.961940 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea775c-7ba2-40dd-897c-0a271413af96 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:03.962222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea775c-7ba2-40dd-897c-0a271413af96 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:03.962499 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea775c-7ba2-40dd-897c-0a271413af96 None admin] PATH_INFO: `/v3/projects/f7f2e076121c4cb2ad3100d223d2119d` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:03.964938 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea775c-7ba2-40dd-897c-0a271413af96 None admin] RBAC: Authorizing `identity:get_project(project_id=f7f2e076121c4cb2ad3100d223d2119d)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:03.966445 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea775c-7ba2-40dd-897c-0a271413af96 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:03.968174 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 45/96] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:03 2022] GET /identity/v3/projects/f7f2e076121c4cb2ad3100d223d2119d => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:03.975551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cdecb-1cef-402c-b7a6-ab9c4fa6809a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:04.105252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cdecb-1cef-402c-b7a6-ab9c4fa6809a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:04.155042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f289f-2699-4dc6-af76-9101d35b62b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:04.155672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f289f-2699-4dc6-af76-9101d35b62b4 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:04.156482 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f289f-2699-4dc6-af76-9101d35b62b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:04.156780 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f289f-2699-4dc6-af76-9101d35b62b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:04.157535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f289f-2699-4dc6-af76-9101d35b62b4 None admin] RBAC: Adding query filter params (role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=f7f2e076121c4cb2ad3100d223d2119d, user.id=c23d5a581fbf45b78bcf03fdbfb9ff89) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:04.157846 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f289f-2699-4dc6-af76-9101d35b62b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:04.159355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f289f-2699-4dc6-af76-9101d35b62b4 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:04.167433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 52/97] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:03 2022] GET /identity/v3/role_assignments?user.id=c23d5a581fbf45b78bcf03fdbfb9ff89&scope.project.id=f7f2e076121c4cb2ad3100d223d2119d&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:06.113492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46dead-9ad4-483f-bef6-4a71e76e4d62 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:06.114143 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46dead-9ad4-483f-bef6-4a71e76e4d62 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:06.114302 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30296e78-8934-4dd3-b5ca-bc6e55bc3d22 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:06.114738 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46dead-9ad4-483f-bef6-4a71e76e4d62 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:06.114896 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30296e78-8934-4dd3-b5ca-bc6e55bc3d22 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:06.114896 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30296e78-8934-4dd3-b5ca-bc6e55bc3d22 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:06.115656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 46/98] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:06.116021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 53/99] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:06.121357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9567e3-23d0-4af8-b2ae-bb329bdda482 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:06.121558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a98a7b-690c-4a9c-a9ce-c78d8e0ea4d8 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:06.121730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9567e3-23d0-4af8-b2ae-bb329bdda482 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:06.121880 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a98a7b-690c-4a9c-a9ce-c78d8e0ea4d8 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:06.122027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9567e3-23d0-4af8-b2ae-bb329bdda482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:06.122170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a98a7b-690c-4a9c-a9ce-c78d8e0ea4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:06.137669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:06.148344 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-db9567e3-23d0-4af8-b2ae-bb329bdda482 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:06.149552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-db9567e3-23d0-4af8-b2ae-bb329bdda482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:06.152025 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-f5a98a7b-690c-4a9c-a9ce-c78d8e0ea4d8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:06.153325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-f5a98a7b-690c-4a9c-a9ce-c78d8e0ea4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:06.175743 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:06.242919 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 47/100] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:06.244610 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600fda8-135f-4ff3-9d96-bcfee2034e2b None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:06.245038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600fda8-135f-4ff3-9d96-bcfee2034e2b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:06.245752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600fda8-135f-4ff3-9d96-bcfee2034e2b None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:06.247253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 48/101] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:06.253374 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c17751-1181-42f1-b40d-53a484d40fae None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:06.253922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c17751-1181-42f1-b40d-53a484d40fae None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:06.254390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c17751-1181-42f1-b40d-53a484d40fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:06.273316 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-63c17751-1181-42f1-b40d-53a484d40fae None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:06.274768 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-63c17751-1181-42f1-b40d-53a484d40fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:06.297294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 54/102] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:06.379751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 49/103] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:06.617076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a98a7b-690c-4a9c-a9ce-c78d8e0ea4d8 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:06.631377 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c17751-1181-42f1-b40d-53a484d40fae None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:06.756216 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a98a7b-690c-4a9c-a9ce-c78d8e0ea4d8 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:06.782347 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:06.809752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c17751-1181-42f1-b40d-53a484d40fae None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:06.826251 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d9f1-feee-4b4a-9239-fdeb3a6a0fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:06.826912 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d9f1-feee-4b4a-9239-fdeb3a6a0fe6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:06.827223 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d9f1-feee-4b4a-9239-fdeb3a6a0fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:06.827719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d9f1-feee-4b4a-9239-fdeb3a6a0fe6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:06.842073 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:06.866740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d9f1-feee-4b4a-9239-fdeb3a6a0fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-8cc9d9f1-feee-4b4a-9239-fdeb3a6a0fe6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:06.871974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:06.872802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:06.873565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 55/104] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:06.884331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39f9dc-7834-4b0e-9637-c654a1c7c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:06.884919 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39f9dc-7834-4b0e-9637-c654a1c7c704 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:06.885258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39f9dc-7834-4b0e-9637-c654a1c7c704 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:06.885540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39f9dc-7834-4b0e-9637-c654a1c7c704 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:06.888160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d9f1-feee-4b4a-9239-fdeb3a6a0fe6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:06.909283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39f9dc-7834-4b0e-9637-c654a1c7c704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-0d39f9dc-7834-4b0e-9637-c654a1c7c704 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:06.914244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:06.915102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:06.915884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 50/105] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:38:06.927063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39f9dc-7834-4b0e-9637-c654a1c7c704 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:07.038814 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39f9dc-7834-4b0e-9637-c654a1c7c704 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:07.076898 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba8ad6-6e6e-42f8-b21f-6b6d8b08dfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:07.077513 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba8ad6-6e6e-42f8-b21f-6b6d8b08dfea None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.077816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba8ad6-6e6e-42f8-b21f-6b6d8b08dfea None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.078123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba8ad6-6e6e-42f8-b21f-6b6d8b08dfea None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.078779 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba8ad6-6e6e-42f8-b21f-6b6d8b08dfea None admin] RBAC: Adding query filter params (name=reader) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:07.079107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba8ad6-6e6e-42f8-b21f-6b6d8b08dfea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:07.081604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba8ad6-6e6e-42f8-b21f-6b6d8b08dfea None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:07.097412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 51/106] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:07.100027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba8ad6-6e6e-42f8-b21f-6b6d8b08dfea None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:07.119403 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d9f1-feee-4b4a-9239-fdeb3a6a0fe6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:07.129059 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:07.199151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394120bf-a924-4c07-88d4-1910e9669848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:07.200032 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394120bf-a924-4c07-88d4-1910e9669848 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.200463 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394120bf-a924-4c07-88d4-1910e9669848 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.200904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394120bf-a924-4c07-88d4-1910e9669848 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.201741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394120bf-a924-4c07-88d4-1910e9669848 None admin] RBAC: Adding query filter params (name=member) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:07.202196 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394120bf-a924-4c07-88d4-1910e9669848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:07.204466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394120bf-a924-4c07-88d4-1910e9669848 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:07.223414 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 56/107] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:07.227021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394120bf-a924-4c07-88d4-1910e9669848 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:07.312363 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba8ad6-6e6e-42f8-b21f-6b6d8b08dfea None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:07.325073 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:07.350199 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d4955-fc00-442e-b805-7cec2b5749c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:07.350932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d4955-fc00-442e-b805-7cec2b5749c0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.351248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d4955-fc00-442e-b805-7cec2b5749c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.351533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d4955-fc00-442e-b805-7cec2b5749c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.352644 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d4955-fc00-442e-b805-7cec2b5749c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:07.354078 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d4955-fc00-442e-b805-7cec2b5749c0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:07.359106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 52/108] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:07.359106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d4955-fc00-442e-b805-7cec2b5749c0 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:07.377447 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394120bf-a924-4c07-88d4-1910e9669848 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:07.417298 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53af949-fc53-458c-ab9b-80a7acd23a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:07.417940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53af949-fc53-458c-ab9b-80a7acd23a55 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.418225 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53af949-fc53-458c-ab9b-80a7acd23a55 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.418503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53af949-fc53-458c-ab9b-80a7acd23a55 None admin] PATH_INFO: `/v3/users/f6820c4eaf3f4c5da715bedfd7d16f16` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.432914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53af949-fc53-458c-ab9b-80a7acd23a55 None admin] RBAC: Authorizing `identity:get_user(user_id=f6820c4eaf3f4c5da715bedfd7d16f16)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:07.434391 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53af949-fc53-458c-ab9b-80a7acd23a55 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:07.436090 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 57/109] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:07 2022] GET /identity/v3/users/f6820c4eaf3f4c5da715bedfd7d16f16 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:07.437389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54c938-8d89-477a-a0c6-293a840fd57c None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.437903 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54c938-8d89-477a-a0c6-293a840fd57c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.438289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54c938-8d89-477a-a0c6-293a840fd57c None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.439545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 58/110] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:07.440636 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62450735-e023-4832-825f-e9a565119f93 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.440840 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62450735-e023-4832-825f-e9a565119f93 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.441119 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62450735-e023-4832-825f-e9a565119f93 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.442457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 59/111] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:07.443007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62450735-e023-4832-825f-e9a565119f93 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:07.450216 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:07.485329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d4955-fc00-442e-b805-7cec2b5749c0 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:07.523608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d97c1d-b7f2-4d37-8dd9-d4e5c6b101ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:07.524389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d97c1d-b7f2-4d37-8dd9-d4e5c6b101ba None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.524679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d97c1d-b7f2-4d37-8dd9-d4e5c6b101ba None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.524961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d97c1d-b7f2-4d37-8dd9-d4e5c6b101ba None admin] PATH_INFO: `/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.526213 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d97c1d-b7f2-4d37-8dd9-d4e5c6b101ba None admin] RBAC: Authorizing `identity:get_user(user_id=c23d5a581fbf45b78bcf03fdbfb9ff89)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:07.527740 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d97c1d-b7f2-4d37-8dd9-d4e5c6b101ba None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:07.529615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 53/112] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:07 2022] GET /identity/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:07.535426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d97c1d-b7f2-4d37-8dd9-d4e5c6b101ba None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:07.553828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62450735-e023-4832-825f-e9a565119f93 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:07.571943 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:07.591718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fcce0-f576-4df3-94fa-72b4ee1c54c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:07.592459 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fcce0-f576-4df3-94fa-72b4ee1c54c5 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.592745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fcce0-f576-4df3-94fa-72b4ee1c54c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.593019 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fcce0-f576-4df3-94fa-72b4ee1c54c5 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.594208 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fcce0-f576-4df3-94fa-72b4ee1c54c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:07.595887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029fcce0-f576-4df3-94fa-72b4ee1c54c5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:07.625948 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 60/113] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:38:07 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:07.627344 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb33e4-a2e2-464c-8e17-beb9717f9c00 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.627640 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb33e4-a2e2-464c-8e17-beb9717f9c00 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.627924 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb33e4-a2e2-464c-8e17-beb9717f9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.650039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-7ffb33e4-a2e2-464c-8e17-beb9717f9c00 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:07.651075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d97c1d-b7f2-4d37-8dd9-d4e5c6b101ba None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:07.651405 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-7ffb33e4-a2e2-464c-8e17-beb9717f9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:07.693555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b7156-6c05-4bfc-82b9-1d356439d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:07.694202 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7156-6c05-4bfc-82b9-1d356439d3b7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.694493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7156-6c05-4bfc-82b9-1d356439d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.694774 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b7156-6c05-4bfc-82b9-1d356439d3b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.709557 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:07.732829 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 61/114] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:07.734426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abbfb5-f901-4d77-80cf-fde2d527e3cd None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.734941 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abbfb5-f901-4d77-80cf-fde2d527e3cd None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.735444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abbfb5-f901-4d77-80cf-fde2d527e3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.769214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-97abbfb5-f901-4d77-80cf-fde2d527e3cd None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:07.770809 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-97abbfb5-f901-4d77-80cf-fde2d527e3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:07.778405 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b7156-6c05-4bfc-82b9-1d356439d3b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:07.780277 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b7156-6c05-4bfc-82b9-1d356439d3b7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:07.854793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 62/115] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:07.855886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abbfb5-f901-4d77-80cf-fde2d527e3cd None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:07.894363 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 54/116] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:07.894576 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:07.900483 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bae04d-b4dd-42e7-b8b1-48c56533a65c None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:07.900933 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bae04d-b4dd-42e7-b8b1-48c56533a65c None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:07.901350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bae04d-b4dd-42e7-b8b1-48c56533a65c None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:07.902887 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 55/117] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:07.903823 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bae04d-b4dd-42e7-b8b1-48c56533a65c None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:07.971258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abbfb5-f901-4d77-80cf-fde2d527e3cd None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:08.010695 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:08.014447 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ad45d-59f6-4e37-85aa-e1e64033172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:08.016359 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ad45d-59f6-4e37-85aa-e1e64033172f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:08.016990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ad45d-59f6-4e37-85aa-e1e64033172f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:08.017351 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ad45d-59f6-4e37-85aa-e1e64033172f None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:08.018860 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ad45d-59f6-4e37-85aa-e1e64033172f None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:08.020448 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ad45d-59f6-4e37-85aa-e1e64033172f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:08.022364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 63/118] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:07 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:08.028106 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359eb46-6b3e-449e-981a-82f0aeb6a1ba None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:08.028489 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359eb46-6b3e-449e-981a-82f0aeb6a1ba None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:08.028843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359eb46-6b3e-449e-981a-82f0aeb6a1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:08.060279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-1359eb46-6b3e-449e-981a-82f0aeb6a1ba None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:08.061961 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-1359eb46-6b3e-449e-981a-82f0aeb6a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:08.143850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 64/119] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:08.144816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359eb46-6b3e-449e-981a-82f0aeb6a1ba None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:08.145339 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bae04d-b4dd-42e7-b8b1-48c56533a65c None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:08.177316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:08.226068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffce79-942e-4a83-8c29-ad7832708a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:08.227016 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffce79-942e-4a83-8c29-ad7832708a97 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:08.227472 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffce79-942e-4a83-8c29-ad7832708a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:08.227917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffce79-942e-4a83-8c29-ad7832708a97 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:08.229295 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffce79-942e-4a83-8c29-ad7832708a97 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:08.231169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffce79-942e-4a83-8c29-ad7832708a97 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:08.233126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 56/120] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:07 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:08.234847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffce79-942e-4a83-8c29-ad7832708a97 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:08.253685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359eb46-6b3e-449e-981a-82f0aeb6a1ba None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:08.290097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7623c-e6d8-43ff-adbc-8bb15ba554a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:08.290870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7623c-e6d8-43ff-adbc-8bb15ba554a4 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:08.291259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7623c-e6d8-43ff-adbc-8bb15ba554a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:08.291612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7623c-e6d8-43ff-adbc-8bb15ba554a4 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/users/c23d5a581fbf45b78bcf03fdbfb9ff89/roles/5039147f7bed444380ba0a7d7b6c2269` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:08.293621 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7623c-e6d8-43ff-adbc-8bb15ba554a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3c937f73cf7454483a3ae2f627fad5a, user_id=c23d5a581fbf45b78bcf03fdbfb9ff89, role_id=5039147f7bed444380ba0a7d7b6c2269)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:08.295244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7623c-e6d8-43ff-adbc-8bb15ba554a4 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:08.312213 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 65/121] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:38:08 2022] PUT /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/users/c23d5a581fbf45b78bcf03fdbfb9ff89/roles/5039147f7bed444380ba0a7d7b6c2269 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:08.319961 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7623c-e6d8-43ff-adbc-8bb15ba554a4 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:08.457300 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffce79-942e-4a83-8c29-ad7832708a97 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:08.479422 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:08.500691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c62466-2802-4b33-a4df-334da01f2662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:08.501721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c62466-2802-4b33-a4df-334da01f2662 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:08.502201 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c62466-2802-4b33-a4df-334da01f2662 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:08.502693 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c62466-2802-4b33-a4df-334da01f2662 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:08.507433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:08.521685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c62466-2802-4b33-a4df-334da01f2662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-51c62466-2802-4b33-a4df-334da01f2662 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:08.527459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:08.528383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:08.529171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 57/122] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:08.529812 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c62466-2802-4b33-a4df-334da01f2662 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:08.530731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7623c-e6d8-43ff-adbc-8bb15ba554a4 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:08.580295 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342e05-d1d8-4ff3-9682-ea26b2eb9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:08.581422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342e05-d1d8-4ff3-9682-ea26b2eb9404 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:08.582189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342e05-d1d8-4ff3-9682-ea26b2eb9404 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:08.583200 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a342e05-d1d8-4ff3-9682-ea26b2eb9404 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:08.600968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a342e05-d1d8-4ff3-9682-ea26b2eb9404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-5a342e05-d1d8-4ff3-9682-ea26b2eb9404 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:08.609720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:08.610654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 66/123] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:08.613379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342e05-d1d8-4ff3-9682-ea26b2eb9404 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:08.659917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c62466-2802-4b33-a4df-334da01f2662 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:08.699055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208a03e-a863-46fa-9b94-c8fe79617a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:08.699682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208a03e-a863-46fa-9b94-c8fe79617a0e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:08.699967 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208a03e-a863-46fa-9b94-c8fe79617a0e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:08.700307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208a03e-a863-46fa-9b94-c8fe79617a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:08.701039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208a03e-a863-46fa-9b94-c8fe79617a0e None admin] RBAC: Adding query filter params (role.id=6cbe97afa726447d8f6888e2faddeea4, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a, user.id=f6820c4eaf3f4c5da715bedfd7d16f16) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:08.701399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208a03e-a863-46fa-9b94-c8fe79617a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:08.703543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208a03e-a863-46fa-9b94-c8fe79617a0e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:08.718977 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 58/124] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:08 2022] GET /identity/v3/role_assignments?user.id=f6820c4eaf3f4c5da715bedfd7d16f16&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=6cbe97afa726447d8f6888e2faddeea4 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:08.718977 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208a03e-a863-46fa-9b94-c8fe79617a0e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:08.772900 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a342e05-d1d8-4ff3-9682-ea26b2eb9404 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:08.791522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:08.844185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256b2ac-7376-4b31-b35d-da1be173250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:08.844937 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b2ac-7376-4b31-b35d-da1be173250f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:08.845223 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b2ac-7376-4b31-b35d-da1be173250f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:08.845504 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b2ac-7376-4b31-b35d-da1be173250f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:08.870138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256b2ac-7376-4b31-b35d-da1be173250f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c256b2ac-7376-4b31-b35d-da1be173250f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:08.875982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:08.876875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:08.877650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:08.879593 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 67/125] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:08.887313 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256b2ac-7376-4b31-b35d-da1be173250f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:08.911185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:08.929257 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208a03e-a863-46fa-9b94-c8fe79617a0e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:08.999581 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7df42-d521-49df-848b-c4e5d6b9aa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:09.000682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7df42-d521-49df-848b-c4e5d6b9aa62 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:09.001940 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7df42-d521-49df-848b-c4e5d6b9aa62 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:09.002418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7df42-d521-49df-848b-c4e5d6b9aa62 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:09.003973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7df42-d521-49df-848b-c4e5d6b9aa62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:09.004658 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7df42-d521-49df-848b-c4e5d6b9aa62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:09.007389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7df42-d521-49df-848b-c4e5d6b9aa62 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:09.025915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 59/126] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:09.027411 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7df42-d521-49df-848b-c4e5d6b9aa62 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:09.065955 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256b2ac-7376-4b31-b35d-da1be173250f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:09.110039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2cc74-36ce-4ca4-87ee-89cc841b5ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:09.111513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2cc74-36ce-4ca4-87ee-89cc841b5ce8 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:09.111802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2cc74-36ce-4ca4-87ee-89cc841b5ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:09.112082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2cc74-36ce-4ca4-87ee-89cc841b5ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:09.112756 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2cc74-36ce-4ca4-87ee-89cc841b5ce8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:09.113066 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2cc74-36ce-4ca4-87ee-89cc841b5ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:09.114468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2cc74-36ce-4ca4-87ee-89cc841b5ce8 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:09.137558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 68/127] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:09.138246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2cc74-36ce-4ca4-87ee-89cc841b5ce8 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:09.187839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:09.196663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7df42-d521-49df-848b-c4e5d6b9aa62 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:09.239368 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:09.272333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2cc74-36ce-4ca4-87ee-89cc841b5ce8 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:09.284334 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41779a-0b8c-4887-a356-a1438007fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:09.285262 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41779a-0b8c-4887-a356-a1438007fe87 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:09.285743 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41779a-0b8c-4887-a356-a1438007fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:09.286232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41779a-0b8c-4887-a356-a1438007fe87 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:09.287156 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41779a-0b8c-4887-a356-a1438007fe87 None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:09.287663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41779a-0b8c-4887-a356-a1438007fe87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:09.289250 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41779a-0b8c-4887-a356-a1438007fe87 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:09.309031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857a9e7-4a91-4ca3-8711-f7ba700bbd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:09.309680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857a9e7-4a91-4ca3-8711-f7ba700bbd2a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:09.309968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857a9e7-4a91-4ca3-8711-f7ba700bbd2a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:09.310249 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857a9e7-4a91-4ca3-8711-f7ba700bbd2a None admin] PATH_INFO: `/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:09.311693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857a9e7-4a91-4ca3-8711-f7ba700bbd2a None admin] RBAC: Authorizing `identity:get_user(user_id=c23d5a581fbf45b78bcf03fdbfb9ff89)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:09.313367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857a9e7-4a91-4ca3-8711-f7ba700bbd2a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:09.314554 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 60/128] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:09.314980 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 69/129] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:09 2022] GET /identity/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:09.315809 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41779a-0b8c-4887-a356-a1438007fe87 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:09.321127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857a9e7-4a91-4ca3-8711-f7ba700bbd2a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:09.432696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41779a-0b8c-4887-a356-a1438007fe87 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:09.472544 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76feb9-460d-4db7-9fc8-9724cd1fbc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:09.473579 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76feb9-460d-4db7-9fc8-9724cd1fbc18 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:09.474114 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76feb9-460d-4db7-9fc8-9724cd1fbc18 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:09.474618 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76feb9-460d-4db7-9fc8-9724cd1fbc18 None admin] PATH_INFO: `/v3/users/eb12f0f56c9240608c4e9af189715bfa` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:09.476311 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76feb9-460d-4db7-9fc8-9724cd1fbc18 None admin] RBAC: Authorizing `identity:get_user(user_id=eb12f0f56c9240608c4e9af189715bfa)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:09.478296 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76feb9-460d-4db7-9fc8-9724cd1fbc18 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:09.480281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 61/130] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:09 2022] GET /identity/v3/users/eb12f0f56c9240608c4e9af189715bfa => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:09.481287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76feb9-460d-4db7-9fc8-9724cd1fbc18 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:09.514561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:09.557971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857a9e7-4a91-4ca3-8711-f7ba700bbd2a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:09.607788 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c62be-f4cf-4c03-b6ae-fefcb98d7800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:09.609685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c62be-f4cf-4c03-b6ae-fefcb98d7800 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:09.610203 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c62be-f4cf-4c03-b6ae-fefcb98d7800 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:09.610691 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c62be-f4cf-4c03-b6ae-fefcb98d7800 None admin] PATH_INFO: `/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:09.612348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c62be-f4cf-4c03-b6ae-fefcb98d7800 None admin] RBAC: Authorizing `identity:get_user(user_id=c23d5a581fbf45b78bcf03fdbfb9ff89)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:09.614153 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c62be-f4cf-4c03-b6ae-fefcb98d7800 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:09.616023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 70/131] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:09 2022] GET /identity/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:09.617328 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c62be-f4cf-4c03-b6ae-fefcb98d7800 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:09.627091 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76feb9-460d-4db7-9fc8-9724cd1fbc18 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:09.628208 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:09.697691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487981f6-6938-4081-ba63-962cb2577583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:09.698655 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487981f6-6938-4081-ba63-962cb2577583 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:09.699131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487981f6-6938-4081-ba63-962cb2577583 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:09.699549 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487981f6-6938-4081-ba63-962cb2577583 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:09.704545 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487981f6-6938-4081-ba63-962cb2577583 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:09.706779 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487981f6-6938-4081-ba63-962cb2577583 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:09.708762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 62/132] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:09 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:09.709670 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487981f6-6938-4081-ba63-962cb2577583 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:09.733622 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c62be-f4cf-4c03-b6ae-fefcb98d7800 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:09.777187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd825-214c-4a2e-8b59-78aa0a3402d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:09.778180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd825-214c-4a2e-8b59-78aa0a3402d1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:09.778572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd825-214c-4a2e-8b59-78aa0a3402d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:09.778971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd825-214c-4a2e-8b59-78aa0a3402d1 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:09.784326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dd825-214c-4a2e-8b59-78aa0a3402d1 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:09.785805 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dd825-214c-4a2e-8b59-78aa0a3402d1 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:09.796345 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 71/133] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:09 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:09.797871 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd825-214c-4a2e-8b59-78aa0a3402d1 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:09.890970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:09.932069 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd825-214c-4a2e-8b59-78aa0a3402d1 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:09.967316 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:09.987639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487981f6-6938-4081-ba63-962cb2577583 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:09.987811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a888a-7029-4c5c-b479-f148802faf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:09.988468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a888a-7029-4c5c-b479-f148802faf74 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:09.988755 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a888a-7029-4c5c-b479-f148802faf74 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:09.989038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a888a-7029-4c5c-b479-f148802faf74 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/users/c23d5a581fbf45b78bcf03fdbfb9ff89/roles/44e0a79b0d8942bbb803f5a4cb669d6e` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:09.996039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a888a-7029-4c5c-b479-f148802faf74 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3c937f73cf7454483a3ae2f627fad5a, user_id=c23d5a581fbf45b78bcf03fdbfb9ff89, role_id=44e0a79b0d8942bbb803f5a4cb669d6e)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:09.997508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a888a-7029-4c5c-b479-f148802faf74 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:10.021180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 72/134] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:38:09 2022] PUT /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/users/c23d5a581fbf45b78bcf03fdbfb9ff89/roles/44e0a79b0d8942bbb803f5a4cb669d6e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:10.022075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a888a-7029-4c5c-b479-f148802faf74 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:10.067509 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ddcde-712c-42cd-85af-cacaecaf46d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:10.068163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ddcde-712c-42cd-85af-cacaecaf46d7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:10.068450 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ddcde-712c-42cd-85af-cacaecaf46d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:10.068732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ddcde-712c-42cd-85af-cacaecaf46d7 None admin] PATH_INFO: `/v3/projects/f7f2e076121c4cb2ad3100d223d2119d` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:10.072065 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ddcde-712c-42cd-85af-cacaecaf46d7 None admin] RBAC: Authorizing `identity:get_project(project_id=f7f2e076121c4cb2ad3100d223d2119d)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:10.075148 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ddcde-712c-42cd-85af-cacaecaf46d7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:10.076849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 63/135] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:09 2022] GET /identity/v3/projects/f7f2e076121c4cb2ad3100d223d2119d => generated 312 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:10.083095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ddcde-712c-42cd-85af-cacaecaf46d7 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:10.252066 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a888a-7029-4c5c-b479-f148802faf74 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:10.261888 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ddcde-712c-42cd-85af-cacaecaf46d7 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:10.303125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d571dd7-b4aa-4841-974c-6ce4f9c4c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:10.303816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d571dd7-b4aa-4841-974c-6ce4f9c4c69f None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:10.304108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d571dd7-b4aa-4841-974c-6ce4f9c4c69f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:10.304396 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d571dd7-b4aa-4841-974c-6ce4f9c4c69f None admin] PATH_INFO: `/v3/projects/f7f2e076121c4cb2ad3100d223d2119d/users/c23d5a581fbf45b78bcf03fdbfb9ff89/roles/5039147f7bed444380ba0a7d7b6c2269` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:10.306559 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d571dd7-b4aa-4841-974c-6ce4f9c4c69f None admin] RBAC: Authorizing `identity:create_grant(project_id=f7f2e076121c4cb2ad3100d223d2119d, user_id=c23d5a581fbf45b78bcf03fdbfb9ff89, role_id=5039147f7bed444380ba0a7d7b6c2269)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:10.308081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d571dd7-b4aa-4841-974c-6ce4f9c4c69f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:10.320288 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:10.327478 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 64/136] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:38:10 2022] PUT /identity/v3/projects/f7f2e076121c4cb2ad3100d223d2119d/users/c23d5a581fbf45b78bcf03fdbfb9ff89/roles/5039147f7bed444380ba0a7d7b6c2269 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:10.329857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274a180-3a45-4268-bda8-ae401fc3af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:10.330676 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274a180-3a45-4268-bda8-ae401fc3af54 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:10.330997 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274a180-3a45-4268-bda8-ae401fc3af54 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:10.331294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274a180-3a45-4268-bda8-ae401fc3af54 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/users/eb12f0f56c9240608c4e9af189715bfa/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:10.336259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274a180-3a45-4268-bda8-ae401fc3af54 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3c937f73cf7454483a3ae2f627fad5a, user_id=eb12f0f56c9240608c4e9af189715bfa, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:10.337834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274a180-3a45-4268-bda8-ae401fc3af54 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:10.368432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 73/137] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:38:10 2022] PUT /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/users/eb12f0f56c9240608c4e9af189715bfa/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:10.463424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5c63e-2d73-4a12-bb91-013cad17fbec None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:10.463871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5c63e-2d73-4a12-bb91-013cad17fbec None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:10.464254 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5c63e-2d73-4a12-bb91-013cad17fbec None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:10.466171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 65/138] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:10.472439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87902-fa21-411a-afa4-9f38e0be64c2 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:10.472754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87902-fa21-411a-afa4-9f38e0be64c2 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:10.473010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87902-fa21-411a-afa4-9f38e0be64c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:10.501795 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-1bd87902-fa21-411a-afa4-9f38e0be64c2 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:10.503199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-1bd87902-fa21-411a-afa4-9f38e0be64c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:10.602591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 74/139] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:10.993162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5c63e-2d73-4a12-bb91-013cad17fbec None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:11.024571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:11.129067 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5c63e-2d73-4a12-bb91-013cad17fbec None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:11.178489 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555e684-b2bb-4079-8bdc-f30ce60cc0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:11.179173 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555e684-b2bb-4079-8bdc-f30ce60cc0dd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:11.179463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555e684-b2bb-4079-8bdc-f30ce60cc0dd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:11.179743 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555e684-b2bb-4079-8bdc-f30ce60cc0dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:11.180855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555e684-b2bb-4079-8bdc-f30ce60cc0dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:11.182309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555e684-b2bb-4079-8bdc-f30ce60cc0dd None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:11.184080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 66/140] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:11.190059 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd87902-fa21-411a-afa4-9f38e0be64c2 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:11.241367 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46a2e-df0d-4a2b-91ca-d03b637068b0 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:11.241679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46a2e-df0d-4a2b-91ca-d03b637068b0 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:11.241929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc46a2e-df0d-4a2b-91ca-d03b637068b0 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:11.243493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 67/141] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:11.249128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7e62-4f10-43a9-ba8f-a543db67ade1 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:11.249416 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7e62-4f10-43a9-ba8f-a543db67ade1 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:11.249816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7e62-4f10-43a9-ba8f-a543db67ade1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:11.276028 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-d64f7e62-4f10-43a9-ba8f-a543db67ade1 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:11.278064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-d64f7e62-4f10-43a9-ba8f-a543db67ade1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:11.394724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd87902-fa21-411a-afa4-9f38e0be64c2 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:11.430379 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 68/142] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:11.444045 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:11.452172 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71921beb-5cc9-424d-8ce4-f56fca3bee22 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:11.452471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71921beb-5cc9-424d-8ce4-f56fca3bee22 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:11.452914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71921beb-5cc9-424d-8ce4-f56fca3bee22 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:11.454594 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 69/143] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:11.459826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd0ed-ae22-4ca1-b3a3-b4117b8af15a None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:11.460327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd0ed-ae22-4ca1-b3a3-b4117b8af15a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:11.460793 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bd0ed-ae22-4ca1-b3a3-b4117b8af15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:11.482548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acaa7b-e353-43e8-944d-ab479a37d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:11.483505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acaa7b-e353-43e8-944d-ab479a37d5a2 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:11.483982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acaa7b-e353-43e8-944d-ab479a37d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:11.484403 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acaa7b-e353-43e8-944d-ab479a37d5a2 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:11.485261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acaa7b-e353-43e8-944d-ab479a37d5a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:11.487553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acaa7b-e353-43e8-944d-ab479a37d5a2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:11.491942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-3b5bd0ed-ae22-4ca1-b3a3-b4117b8af15a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:11.493349 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-3b5bd0ed-ae22-4ca1-b3a3-b4117b8af15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:11.514452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:11.530167 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 75/144] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:11 2022] POST /identity/v3/users => generated 283 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:11.610930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 70/145] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:11.737252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acaa7b-e353-43e8-944d-ab479a37d5a2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:11.884699 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acaa7b-e353-43e8-944d-ab479a37d5a2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:11.931744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8a8f4-79ce-45bb-9b40-97814213c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:11.932385 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8a8f4-79ce-45bb-9b40-97814213c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:11.932668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8a8f4-79ce-45bb-9b40-97814213c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:11.932946 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8a8f4-79ce-45bb-9b40-97814213c2c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:11.951809 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8a8f4-79ce-45bb-9b40-97814213c2c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-17f8a8f4-79ce-45bb-9b40-97814213c2c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:11.958475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:11.959355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:11.960238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 76/146] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:11.966776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bd0ed-ae22-4ca1-b3a3-b4117b8af15a None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:12.075327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8a8f4-79ce-45bb-9b40-97814213c2c2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:12.100789 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bd0ed-ae22-4ca1-b3a3-b4117b8af15a None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:12.159389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1069c-7772-4140-a555-8b6973328d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:12.159935 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1069c-7772-4140-a555-8b6973328d6b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:12.160220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1069c-7772-4140-a555-8b6973328d6b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:12.160501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1069c-7772-4140-a555-8b6973328d6b None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:12.161170 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1069c-7772-4140-a555-8b6973328d6b None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:12.161477 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1069c-7772-4140-a555-8b6973328d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:12.162867 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1069c-7772-4140-a555-8b6973328d6b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:12.175301 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:12.176574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 71/147] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:12.185290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1069c-7772-4140-a555-8b6973328d6b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:12.216153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:12.282517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8a8f4-79ce-45bb-9b40-97814213c2c2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:12.314883 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1069c-7772-4140-a555-8b6973328d6b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:12.328361 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a1115-6771-49d0-a53f-c5737194d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:12.329014 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a1115-6771-49d0-a53f-c5737194d1ef None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:12.330054 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a1115-6771-49d0-a53f-c5737194d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:12.330478 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a1115-6771-49d0-a53f-c5737194d1ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:12.345740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a1115-6771-49d0-a53f-c5737194d1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c84a1115-6771-49d0-a53f-c5737194d1ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:12.353774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:12.354822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:12.355808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:12.358295 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 77/148] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:12.358931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa683e-7a22-47a4-969d-d035f782bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:12.359928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa683e-7a22-47a4-969d-d035f782bc9b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:12.360245 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa683e-7a22-47a4-969d-d035f782bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:12.360524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa683e-7a22-47a4-969d-d035f782bc9b None admin] PATH_INFO: `/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:12.361677 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa683e-7a22-47a4-969d-d035f782bc9b None admin] RBAC: Authorizing `identity:get_user(user_id=c23d5a581fbf45b78bcf03fdbfb9ff89)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:12.363180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa683e-7a22-47a4-969d-d035f782bc9b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:12.363941 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a1115-6771-49d0-a53f-c5737194d1ef None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:12.364888 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 72/149] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:12 2022] GET /identity/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:12.371363 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa683e-7a22-47a4-969d-d035f782bc9b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:12.475010 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:12.488612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:12.494136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a1115-6771-49d0-a53f-c5737194d1ef None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:12.503313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa683e-7a22-47a4-969d-d035f782bc9b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:12.545759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c86efc-0dc8-4a24-a477-b9b4f761e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:12.547078 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c86efc-0dc8-4a24-a477-b9b4f761e529 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:12.547423 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c86efc-0dc8-4a24-a477-b9b4f761e529 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:12.547742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c86efc-0dc8-4a24-a477-b9b4f761e529 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:12.548421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c86efc-0dc8-4a24-a477-b9b4f761e529 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:12.548784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c86efc-0dc8-4a24-a477-b9b4f761e529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:12.550479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c86efc-0dc8-4a24-a477-b9b4f761e529 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:12.560636 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 78/150] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:12.566579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c86efc-0dc8-4a24-a477-b9b4f761e529 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:12.567943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240bdd-c3ae-46d1-a6a4-13841ec57470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:12.568562 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240bdd-c3ae-46d1-a6a4-13841ec57470 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:12.568845 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240bdd-c3ae-46d1-a6a4-13841ec57470 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:12.572655 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240bdd-c3ae-46d1-a6a4-13841ec57470 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:12.713086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1240bdd-c3ae-46d1-a6a4-13841ec57470 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:12.714891 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1240bdd-c3ae-46d1-a6a4-13841ec57470 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:12.740657 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c86efc-0dc8-4a24-a477-b9b4f761e529 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:12.804814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b401440-eefe-48a6-a379-f4251afe116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:12.804814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b401440-eefe-48a6-a379-f4251afe116f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:12.804814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b401440-eefe-48a6-a379-f4251afe116f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:12.804814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b401440-eefe-48a6-a379-f4251afe116f None admin] PATH_INFO: `/v3/users/f6820c4eaf3f4c5da715bedfd7d16f16` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:12.805651 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b401440-eefe-48a6-a379-f4251afe116f None admin] RBAC: Authorizing `identity:get_user(user_id=f6820c4eaf3f4c5da715bedfd7d16f16)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:12.807247 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b401440-eefe-48a6-a379-f4251afe116f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:12.809284 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 79/151] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:12 2022] GET /identity/v3/users/f6820c4eaf3f4c5da715bedfd7d16f16 => generated 289 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:12.814372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:12.815753 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b401440-eefe-48a6-a379-f4251afe116f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:12.834626 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 73/152] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:12.842151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240bdd-c3ae-46d1-a6a4-13841ec57470 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:12.870174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:12.959689 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1240bdd-c3ae-46d1-a6a4-13841ec57470 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:13.009866 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378b547-9a15-4218-b37f-698621198e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:13.010825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b547-9a15-4218-b37f-698621198e5f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:13.011362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b547-9a15-4218-b37f-698621198e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:13.011827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b547-9a15-4218-b37f-698621198e5f None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:13.012398 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b401440-eefe-48a6-a379-f4251afe116f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:13.013382 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378b547-9a15-4218-b37f-698621198e5f None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:13.015279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378b547-9a15-4218-b37f-698621198e5f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:13.017551 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 74/153] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:12 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:13.023123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378b547-9a15-4218-b37f-698621198e5f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:13.052603 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc31a-bd1e-4a9e-89fb-b424ca1e18d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:13.053260 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc31a-bd1e-4a9e-89fb-b424ca1e18d9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:13.053552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc31a-bd1e-4a9e-89fb-b424ca1e18d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:13.053828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc31a-bd1e-4a9e-89fb-b424ca1e18d9 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:13.054975 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbc31a-bd1e-4a9e-89fb-b424ca1e18d9 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:13.056498 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbc31a-bd1e-4a9e-89fb-b424ca1e18d9 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:13.058601 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 80/154] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:12 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:13.067211 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc31a-bd1e-4a9e-89fb-b424ca1e18d9 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:13.107493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:13.166683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378b547-9a15-4218-b37f-698621198e5f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:13.214720 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce9d17-c7da-4fa0-878b-17172859329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:13.215538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce9d17-c7da-4fa0-878b-17172859329c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:13.215917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce9d17-c7da-4fa0-878b-17172859329c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:13.216290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce9d17-c7da-4fa0-878b-17172859329c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:13.217119 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce9d17-c7da-4fa0-878b-17172859329c None admin] RBAC: Adding query filter params (role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a, user.id=c23d5a581fbf45b78bcf03fdbfb9ff89) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:13.217533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce9d17-c7da-4fa0-878b-17172859329c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:13.219852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce9d17-c7da-4fa0-878b-17172859329c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:13.226760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 75/155] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:13 2022] GET /identity/v3/role_assignments?user.id=c23d5a581fbf45b78bcf03fdbfb9ff89&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:13.300086 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:13.306329 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc31a-bd1e-4a9e-89fb-b424ca1e18d9 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:13.368723 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814d410-45dc-44c7-86a9-7fc13679c27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:13.369426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d410-45dc-44c7-86a9-7fc13679c27d None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:13.369777 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d410-45dc-44c7-86a9-7fc13679c27d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:13.370064 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d410-45dc-44c7-86a9-7fc13679c27d None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/users/f6820c4eaf3f4c5da715bedfd7d16f16/roles/6cbe97afa726447d8f6888e2faddeea4` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:13.372325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814d410-45dc-44c7-86a9-7fc13679c27d None admin] RBAC: Authorizing `identity:create_grant(project_id=d3c937f73cf7454483a3ae2f627fad5a, user_id=f6820c4eaf3f4c5da715bedfd7d16f16, role_id=6cbe97afa726447d8f6888e2faddeea4)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:13.373780 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814d410-45dc-44c7-86a9-7fc13679c27d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:13.399292 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 81/156] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:38:13 2022] PUT /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/users/f6820c4eaf3f4c5da715bedfd7d16f16/roles/6cbe97afa726447d8f6888e2faddeea4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:13.715010 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e6ed-f86d-464a-bc20-6b0aecc7e430 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:13.715613 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e6ed-f86d-464a-bc20-6b0aecc7e430 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:13.715613 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e6ed-f86d-464a-bc20-6b0aecc7e430 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:13.716916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 76/157] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:13.724245 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456afc03-e0c1-4aa7-b2e1-0d150f46e30c None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:13.724733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456afc03-e0c1-4aa7-b2e1-0d150f46e30c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:13.724813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456afc03-e0c1-4aa7-b2e1-0d150f46e30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:13.745717 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-456afc03-e0c1-4aa7-b2e1-0d150f46e30c None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:13.747089 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-456afc03-e0c1-4aa7-b2e1-0d150f46e30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:13.835965 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 82/158] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:14.409776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545e6ed-f86d-464a-bc20-6b0aecc7e430 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:14.433048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a666f2-4ae3-4fa4-aa2f-5579bae00964 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:14.433387 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a666f2-4ae3-4fa4-aa2f-5579bae00964 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:14.433608 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a666f2-4ae3-4fa4-aa2f-5579bae00964 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:14.435139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 83/159] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:14.446103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83603d61-bd4a-4036-aecd-530d9765e33b None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:14.446390 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83603d61-bd4a-4036-aecd-530d9765e33b None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:14.446673 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83603d61-bd4a-4036-aecd-530d9765e33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:14.473163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-83603d61-bd4a-4036-aecd-530d9765e33b None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:14.474707 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-83603d61-bd4a-4036-aecd-530d9765e33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:14.598655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 84/160] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:14.651583 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545e6ed-f86d-464a-bc20-6b0aecc7e430 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:14.663529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a291-8e30-46a8-a4b9-57a6ec7b1063 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:14.664121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a291-8e30-46a8-a4b9-57a6ec7b1063 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:14.664597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957a291-8e30-46a8-a4b9-57a6ec7b1063 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:14.671705 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 85/161] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:14.677520 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274be2-fe74-4cb1-9f51-042de4d9d23d None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:14.678104 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274be2-fe74-4cb1-9f51-042de4d9d23d None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:14.678573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274be2-fe74-4cb1-9f51-042de4d9d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:14.695301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:14.712443 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-e1274be2-fe74-4cb1-9f51-042de4d9d23d None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:14.716450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-e1274be2-fe74-4cb1-9f51-042de4d9d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:14.738069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0312b-be6d-436c-8f89-3a13698e29e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:14.738731 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0312b-be6d-436c-8f89-3a13698e29e7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:14.738995 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0312b-be6d-436c-8f89-3a13698e29e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:14.739273 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0312b-be6d-436c-8f89-3a13698e29e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:14.739670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:14.767685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0312b-be6d-436c-8f89-3a13698e29e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-96f0312b-be6d-436c-8f89-3a13698e29e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:14.773871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:14.774778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:14.775721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 77/162] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:14.781706 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0312b-be6d-436c-8f89-3a13698e29e7 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:14.884275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 86/163] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:14.960140 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0312b-be6d-436c-8f89-3a13698e29e7 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:15.001121 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060363e-6318-4ddd-8394-48e3dfeea9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:15.007632 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060363e-6318-4ddd-8394-48e3dfeea9df None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:15.008092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060363e-6318-4ddd-8394-48e3dfeea9df None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:15.008516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060363e-6318-4ddd-8394-48e3dfeea9df None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:15.009322 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060363e-6318-4ddd-8394-48e3dfeea9df None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:15.009820 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060363e-6318-4ddd-8394-48e3dfeea9df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:15.011441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060363e-6318-4ddd-8394-48e3dfeea9df None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:15.020951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 78/164] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:15.026615 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1274be2-fe74-4cb1-9f51-042de4d9d23d None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:15.053093 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060363e-6318-4ddd-8394-48e3dfeea9df None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:15.119341 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:15.260371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1274be2-fe74-4cb1-9f51-042de4d9d23d None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:15.261997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060363e-6318-4ddd-8394-48e3dfeea9df None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:15.340224 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436da2a-1ef1-45f2-8ee5-697068ad53ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:15.341263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436da2a-1ef1-45f2-8ee5-697068ad53ec None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:15.341753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436da2a-1ef1-45f2-8ee5-697068ad53ec None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:15.342251 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436da2a-1ef1-45f2-8ee5-697068ad53ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:15.347648 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297abc7-1305-4de6-a800-fc0e80c55575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:15.348307 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297abc7-1305-4de6-a800-fc0e80c55575 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:15.348596 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297abc7-1305-4de6-a800-fc0e80c55575 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:15.348873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297abc7-1305-4de6-a800-fc0e80c55575 None admin] PATH_INFO: `/v3/users/eb12f0f56c9240608c4e9af189715bfa` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:15.350215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297abc7-1305-4de6-a800-fc0e80c55575 None admin] RBAC: Authorizing `identity:get_user(user_id=eb12f0f56c9240608c4e9af189715bfa)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:15.351703 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297abc7-1305-4de6-a800-fc0e80c55575 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:15.353301 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 87/165] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:15 2022] GET /identity/v3/users/eb12f0f56c9240608c4e9af189715bfa => generated 247 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:15.354073 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297abc7-1305-4de6-a800-fc0e80c55575 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:15.376004 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436da2a-1ef1-45f2-8ee5-697068ad53ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-9436da2a-1ef1-45f2-8ee5-697068ad53ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:15.381795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:15.382642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:15.383724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:15.385818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 79/166] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:38:15.386812 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436da2a-1ef1-45f2-8ee5-697068ad53ec None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:15.393492 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:15.574814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297abc7-1305-4de6-a800-fc0e80c55575 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:15.598002 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436da2a-1ef1-45f2-8ee5-697068ad53ec None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:15.611276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:15.648749 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96451-9e9b-4248-9cc2-85a0072f5c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:15.649415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96451-9e9b-4248-9cc2-85a0072f5c98 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:15.649705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96451-9e9b-4248-9cc2-85a0072f5c98 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:15.649982 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c96451-9e9b-4248-9cc2-85a0072f5c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:15.662750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1a6f3-3c83-4f0d-8357-ad184afb68a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:15.663447 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1a6f3-3c83-4f0d-8357-ad184afb68a2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:15.663736 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1a6f3-3c83-4f0d-8357-ad184afb68a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:15.664019 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1a6f3-3c83-4f0d-8357-ad184afb68a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:15.692012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1a6f3-3c83-4f0d-8357-ad184afb68a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-dcd1a6f3-3c83-4f0d-8357-ad184afb68a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:15.696970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:15.697862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:15.698646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 88/167] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:15.699427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1a6f3-3c83-4f0d-8357-ad184afb68a2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:15.758189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96451-9e9b-4248-9cc2-85a0072f5c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:15.759867 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c96451-9e9b-4248-9cc2-85a0072f5c98 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:15.846650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:15.896671 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1a6f3-3c83-4f0d-8357-ad184afb68a2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:15.945276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:15.954426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 80/168] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:15.955659 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96451-9e9b-4248-9cc2-85a0072f5c98 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:15.959844 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd248b95-6262-46d2-bf66-95c0d19ed1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:15.960679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd248b95-6262-46d2-bf66-95c0d19ed1e2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:15.961133 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd248b95-6262-46d2-bf66-95c0d19ed1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:15.961561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd248b95-6262-46d2-bf66-95c0d19ed1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:15.967882 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd248b95-6262-46d2-bf66-95c0d19ed1e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:15.969077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd248b95-6262-46d2-bf66-95c0d19ed1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:15.970715 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd248b95-6262-46d2-bf66-95c0d19ed1e2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:15.986692 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 89/169] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:15.988208 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6217-3392-4577-917a-82a9bb0fc6d4 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:15.988652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6217-3392-4577-917a-82a9bb0fc6d4 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:15.989085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6217-3392-4577-917a-82a9bb0fc6d4 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:15.996587 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 90/170] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:15.997599 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6217-3392-4577-917a-82a9bb0fc6d4 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:16.064462 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c96451-9e9b-4248-9cc2-85a0072f5c98 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:16.105303 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04153711-2f8f-435c-b601-49fcb09f1938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:16.106241 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04153711-2f8f-435c-b601-49fcb09f1938 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.107424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04153711-2f8f-435c-b601-49fcb09f1938 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.108088 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04153711-2f8f-435c-b601-49fcb09f1938 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.110483 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04153711-2f8f-435c-b601-49fcb09f1938 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:16.111030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04153711-2f8f-435c-b601-49fcb09f1938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:16.114255 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04153711-2f8f-435c-b601-49fcb09f1938 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:16.130887 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 81/171] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:16.133091 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b70d6-20d7-4ef0-a6cf-c6aa89365008 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.134241 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b70d6-20d7-4ef0-a6cf-c6aa89365008 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.134894 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b70d6-20d7-4ef0-a6cf-c6aa89365008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.157335 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-cc9b70d6-20d7-4ef0-a6cf-c6aa89365008 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:16.158924 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-cc9b70d6-20d7-4ef0-a6cf-c6aa89365008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:16.213484 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:16.227833 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6217-3392-4577-917a-82a9bb0fc6d4 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:16.251248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 82/172] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:16.252475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b70d6-20d7-4ef0-a6cf-c6aa89365008 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:16.276084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60427114-5f23-421c-be53-2a01e045850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:16.277212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60427114-5f23-421c-be53-2a01e045850d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.277212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60427114-5f23-421c-be53-2a01e045850d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.277390 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60427114-5f23-421c-be53-2a01e045850d None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.279271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60427114-5f23-421c-be53-2a01e045850d None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:16.280820 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60427114-5f23-421c-be53-2a01e045850d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:16.282765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 91/173] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:15 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:16.287779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60427114-5f23-421c-be53-2a01e045850d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:16.301334 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:16.391240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b70d6-20d7-4ef0-a6cf-c6aa89365008 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:16.402971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60427114-5f23-421c-be53-2a01e045850d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:16.456091 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa542ec-4c0a-4f18-bf75-8a2459e98ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:16.456740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa542ec-4c0a-4f18-bf75-8a2459e98ab5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.457023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa542ec-4c0a-4f18-bf75-8a2459e98ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.457300 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa542ec-4c0a-4f18-bf75-8a2459e98ab5 None admin] PATH_INFO: `/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.458918 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b157eff-24d4-4a70-856a-64f899c1dd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:16.459594 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b157eff-24d4-4a70-856a-64f899c1dd88 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.459872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b157eff-24d4-4a70-856a-64f899c1dd88 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.460143 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b157eff-24d4-4a70-856a-64f899c1dd88 None admin] PATH_INFO: `/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.461268 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa542ec-4c0a-4f18-bf75-8a2459e98ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=c23d5a581fbf45b78bcf03fdbfb9ff89)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:16.462724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa542ec-4c0a-4f18-bf75-8a2459e98ab5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:16.465013 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b157eff-24d4-4a70-856a-64f899c1dd88 None admin] RBAC: Authorizing `identity:get_user(user_id=c23d5a581fbf45b78bcf03fdbfb9ff89)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:16.466433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b157eff-24d4-4a70-856a-64f899c1dd88 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:16.467342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 92/174] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:16 2022] GET /identity/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:16.468205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa542ec-4c0a-4f18-bf75-8a2459e98ab5 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:16.468533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 83/175] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:16 2022] GET /identity/v3/users/c23d5a581fbf45b78bcf03fdbfb9ff89 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:16.469767 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a7d7-9d4a-438c-81b0-692fd1356029 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.470054 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a7d7-9d4a-438c-81b0-692fd1356029 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.470329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a7d7-9d4a-438c-81b0-692fd1356029 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.471625 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 84/176] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:16.476076 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5a7d7-9d4a-438c-81b0-692fd1356029 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:16.539614 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:16.620913 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5a7d7-9d4a-438c-81b0-692fd1356029 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:16.631840 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:16.669496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3cd53-bf50-4a29-974d-976957493122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:16.669771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa542ec-4c0a-4f18-bf75-8a2459e98ab5 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:16.670558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3cd53-bf50-4a29-974d-976957493122 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.670935 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3cd53-bf50-4a29-974d-976957493122 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.671398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3cd53-bf50-4a29-974d-976957493122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.708958 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13c260-47e1-4974-8e10-a5c62ef4bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:16.709992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13c260-47e1-4974-8e10-a5c62ef4bfea None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.710442 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13c260-47e1-4974-8e10-a5c62ef4bfea None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.710875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13c260-47e1-4974-8e10-a5c62ef4bfea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.711775 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13c260-47e1-4974-8e10-a5c62ef4bfea None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a, user.id=eb12f0f56c9240608c4e9af189715bfa) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:16.712229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13c260-47e1-4974-8e10-a5c62ef4bfea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:16.713862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13c260-47e1-4974-8e10-a5c62ef4bfea None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:16.721368 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 93/177] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:16 2022] GET /identity/v3/role_assignments?user.id=eb12f0f56c9240608c4e9af189715bfa&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:16.722474 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13c260-47e1-4974-8e10-a5c62ef4bfea None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:16.747507 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3cd53-bf50-4a29-974d-976957493122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:16.749375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3cd53-bf50-4a29-974d-976957493122 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:16.825204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:16.842781 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13c260-47e1-4974-8e10-a5c62ef4bfea None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:16.878229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 85/178] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:16.880030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2aa02-ba93-488d-ba41-07f2e776897a None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.880537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2aa02-ba93-488d-ba41-07f2e776897a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.880953 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2aa02-ba93-488d-ba41-07f2e776897a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.883319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1599d-d020-4011-aa4a-3f169570060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:16.884081 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1599d-d020-4011-aa4a-3f169570060e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:16.884488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1599d-d020-4011-aa4a-3f169570060e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:16.884865 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1599d-d020-4011-aa4a-3f169570060e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:16.888953 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:16.904375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-38c2aa02-ba93-488d-ba41-07f2e776897a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:16.906580 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-38c2aa02-ba93-488d-ba41-07f2e776897a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:16.969622 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1599d-d020-4011-aa4a-3f169570060e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:16.971359 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1599d-d020-4011-aa4a-3f169570060e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:16.983453 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 86/179] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:16.985700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2aa02-ba93-488d-ba41-07f2e776897a None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.092359 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 94/180] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:17.096382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38e87-0dc8-4c4d-8c2c-1d2cd40b7b1a None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.096830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38e87-0dc8-4c4d-8c2c-1d2cd40b7b1a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.097689 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:17.098171 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38e87-0dc8-4c4d-8c2c-1d2cd40b7b1a None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.100059 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 95/181] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:17.100925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38e87-0dc8-4c4d-8c2c-1d2cd40b7b1a None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.123955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2aa02-ba93-488d-ba41-07f2e776897a None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:17.143045 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:17.161231 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf492dad-2364-4f7f-b311-9e953c51c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:17.161871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf492dad-2364-4f7f-b311-9e953c51c39a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.162153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf492dad-2364-4f7f-b311-9e953c51c39a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.162430 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf492dad-2364-4f7f-b311-9e953c51c39a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.176203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf492dad-2364-4f7f-b311-9e953c51c39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-cf492dad-2364-4f7f-b311-9e953c51c39a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:17.182350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:17.183287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:17.184125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 87/182] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:17.184793 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36abb61-be25-45b0-95ea-27d92da96b33 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.185372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36abb61-be25-45b0-95ea-27d92da96b33 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.185372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36abb61-be25-45b0-95ea-27d92da96b33 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.188115 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 88/183] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:17.189074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36abb61-be25-45b0-95ea-27d92da96b33 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.217806 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38e87-0dc8-4c4d-8c2c-1d2cd40b7b1a None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:17.259446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3c031-30a6-4a5a-920a-27de76393068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:17.260510 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3c031-30a6-4a5a-920a-27de76393068 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.261310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3c031-30a6-4a5a-920a-27de76393068 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.261986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3c031-30a6-4a5a-920a-27de76393068 None admin] PATH_INFO: `/v3/projects/f7f2e076121c4cb2ad3100d223d2119d` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.264404 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3c031-30a6-4a5a-920a-27de76393068 None admin] RBAC: Authorizing `identity:get_project(project_id=f7f2e076121c4cb2ad3100d223d2119d)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:17.267604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3c031-30a6-4a5a-920a-27de76393068 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:17.270280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 96/184] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:17 2022] GET /identity/v3/projects/f7f2e076121c4cb2ad3100d223d2119d => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:17.271726 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1109cc-7755-4e5a-a452-a6308608f3f8 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.272220 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1109cc-7755-4e5a-a452-a6308608f3f8 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.272777 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1109cc-7755-4e5a-a452-a6308608f3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.297248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-1f1109cc-7755-4e5a-a452-a6308608f3f8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:17.298440 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-1f1109cc-7755-4e5a-a452-a6308608f3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:17.310207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36abb61-be25-45b0-95ea-27d92da96b33 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:17.344663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c91b4-cdfe-411c-b5cd-45d312f72a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:17.345302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c91b4-cdfe-411c-b5cd-45d312f72a70 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.345586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c91b4-cdfe-411c-b5cd-45d312f72a70 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.345853 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c91b4-cdfe-411c-b5cd-45d312f72a70 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.346972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c91b4-cdfe-411c-b5cd-45d312f72a70 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:17.348409 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c91b4-cdfe-411c-b5cd-45d312f72a70 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:17.350007 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 89/185] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:17 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:17.350760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c91b4-cdfe-411c-b5cd-45d312f72a70 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.364591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 97/186] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:17.365819 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112feae0-7505-4e69-980d-5c06c48fec39 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.366105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112feae0-7505-4e69-980d-5c06c48fec39 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.366376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112feae0-7505-4e69-980d-5c06c48fec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.368090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:17.384987 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-112feae0-7505-4e69-980d-5c06c48fec39 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:17.386152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-112feae0-7505-4e69-980d-5c06c48fec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:17.412561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:17.458978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 98/187] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:17.458978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112feae0-7505-4e69-980d-5c06c48fec39 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.472078 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c91b4-cdfe-411c-b5cd-45d312f72a70 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:17.509162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef018c-ce38-4c59-8879-1fc935730ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:17.510099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef018c-ce38-4c59-8879-1fc935730ed4 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.510428 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef018c-ce38-4c59-8879-1fc935730ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.510821 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef018c-ce38-4c59-8879-1fc935730ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.511705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef018c-ce38-4c59-8879-1fc935730ed4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:17.512118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef018c-ce38-4c59-8879-1fc935730ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:17.513713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef018c-ce38-4c59-8879-1fc935730ed4 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:17.523534 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 90/188] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:17.524526 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef018c-ce38-4c59-8879-1fc935730ed4 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.581641 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112feae0-7505-4e69-980d-5c06c48fec39 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:17.608789 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:17.630475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cce191-6e30-4efb-9221-f4bef91a077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:17.631631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cce191-6e30-4efb-9221-f4bef91a077c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.631992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cce191-6e30-4efb-9221-f4bef91a077c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.632584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cce191-6e30-4efb-9221-f4bef91a077c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.633395 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cce191-6e30-4efb-9221-f4bef91a077c None admin] RBAC: Adding query filter params (role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=f7f2e076121c4cb2ad3100d223d2119d, user.id=c23d5a581fbf45b78bcf03fdbfb9ff89) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:17.633783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cce191-6e30-4efb-9221-f4bef91a077c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:17.636408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cce191-6e30-4efb-9221-f4bef91a077c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:17.638377 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef018c-ce38-4c59-8879-1fc935730ed4 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:17.643800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 99/189] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:17 2022] GET /identity/v3/role_assignments?user.id=c23d5a581fbf45b78bcf03fdbfb9ff89&scope.project.id=f7f2e076121c4cb2ad3100d223d2119d&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:17.644607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cce191-6e30-4efb-9221-f4bef91a077c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.678172 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd063de-f144-4508-bfe8-d6598205daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:17.679281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd063de-f144-4508-bfe8-d6598205daa0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.679769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd063de-f144-4508-bfe8-d6598205daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.680228 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd063de-f144-4508-bfe8-d6598205daa0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.681611 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd063de-f144-4508-bfe8-d6598205daa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:17.683354 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd063de-f144-4508-bfe8-d6598205daa0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:17.684419 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:17.685266 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 91/190] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:17.691399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd063de-f144-4508-bfe8-d6598205daa0 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.786432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cce191-6e30-4efb-9221-f4bef91a077c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:17.829479 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd063de-f144-4508-bfe8-d6598205daa0 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:17.833115 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d624aa-667f-4a71-afe9-cc1bad3f597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:17.833740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d624aa-667f-4a71-afe9-cc1bad3f597e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.834025 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d624aa-667f-4a71-afe9-cc1bad3f597e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.834360 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d624aa-667f-4a71-afe9-cc1bad3f597e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.835129 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d624aa-667f-4a71-afe9-cc1bad3f597e None admin] RBAC: Adding query filter params (role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a, user.id=c23d5a581fbf45b78bcf03fdbfb9ff89) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:17.835492 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d624aa-667f-4a71-afe9-cc1bad3f597e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:17.837456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d624aa-667f-4a71-afe9-cc1bad3f597e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:17.844779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 100/191] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:17 2022] GET /identity/v3/role_assignments?user.id=c23d5a581fbf45b78bcf03fdbfb9ff89&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:17.845685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d624aa-667f-4a71-afe9-cc1bad3f597e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.867491 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37095ff-0390-48f8-8a16-8c9ccec809a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:17.868202 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37095ff-0390-48f8-8a16-8c9ccec809a2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:17.868484 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37095ff-0390-48f8-8a16-8c9ccec809a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:17.868813 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37095ff-0390-48f8-8a16-8c9ccec809a2 None admin] PATH_INFO: `/v3/users/bb32924bf545453382632883c5d636dd` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:17.888948 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:17.892188 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37095ff-0390-48f8-8a16-8c9ccec809a2 None admin] RBAC: Authorizing `identity:get_user(user_id=bb32924bf545453382632883c5d636dd)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:17.894792 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37095ff-0390-48f8-8a16-8c9ccec809a2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:17.897381 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 92/192] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:17 2022] GET /identity/v3/users/bb32924bf545453382632883c5d636dd => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:17.898657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37095ff-0390-48f8-8a16-8c9ccec809a2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:17.972158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:17.983140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d624aa-667f-4a71-afe9-cc1bad3f597e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.022784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59638e-63fe-4d6b-b861-55795a58096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.023476 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59638e-63fe-4d6b-b861-55795a58096f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.023759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59638e-63fe-4d6b-b861-55795a58096f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.024033 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59638e-63fe-4d6b-b861-55795a58096f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.026179 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37095ff-0390-48f8-8a16-8c9ccec809a2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.036179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59638e-63fe-4d6b-b861-55795a58096f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-ae59638e-63fe-4d6b-b861-55795a58096f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:18.041668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:18.042568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 101/193] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:18.047522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59638e-63fe-4d6b-b861-55795a58096f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:18.068235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b822fe-9a1c-429f-8e22-3ba879d94f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.068852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b822fe-9a1c-429f-8e22-3ba879d94f65 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.069131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b822fe-9a1c-429f-8e22-3ba879d94f65 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.069404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b822fe-9a1c-429f-8e22-3ba879d94f65 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.070069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b822fe-9a1c-429f-8e22-3ba879d94f65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:18.071794 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b822fe-9a1c-429f-8e22-3ba879d94f65 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:18.106892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 93/194] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:17 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:18.108326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b822fe-9a1c-429f-8e22-3ba879d94f65 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:18.172436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59638e-63fe-4d6b-b861-55795a58096f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.181397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:18.212258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2d599-2a07-4772-a2f2-605ecdae6164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.212909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d599-2a07-4772-a2f2-605ecdae6164 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.213193 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d599-2a07-4772-a2f2-605ecdae6164 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.213465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d599-2a07-4772-a2f2-605ecdae6164 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.225927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2d599-2a07-4772-a2f2-605ecdae6164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-d5d2d599-2a07-4772-a2f2-605ecdae6164 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:18.231525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:18.232631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:18.233458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 102/195] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:18.234803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2d599-2a07-4772-a2f2-605ecdae6164 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:18.244161 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b822fe-9a1c-429f-8e22-3ba879d94f65 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.252694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:18.288297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1bae0-a363-4763-820e-d9622b99e30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.289297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1bae0-a363-4763-820e-d9622b99e30b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.289733 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1bae0-a363-4763-820e-d9622b99e30b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.290012 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1bae0-a363-4763-820e-d9622b99e30b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.350367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2d599-2a07-4772-a2f2-605ecdae6164 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.373428 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1bae0-a363-4763-820e-d9622b99e30b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:18.375607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1bae0-a363-4763-820e-d9622b99e30b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:18.388946 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6688f-0648-479d-964e-20ee7dd805cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.389890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6688f-0648-479d-964e-20ee7dd805cc None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.390403 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6688f-0648-479d-964e-20ee7dd805cc None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.390801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6688f-0648-479d-964e-20ee7dd805cc None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.391510 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6688f-0648-479d-964e-20ee7dd805cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:18.391817 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6688f-0648-479d-964e-20ee7dd805cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:18.393362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6688f-0648-479d-964e-20ee7dd805cc None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:18.403529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 103/196] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:18.404425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6688f-0648-479d-964e-20ee7dd805cc None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:18.448325 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:18.499998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:18.506222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 94/197] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:18.506909 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1bae0-a363-4763-820e-d9622b99e30b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:18.529338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6688f-0648-479d-964e-20ee7dd805cc None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.573402 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf852bba-2e40-4716-804a-1229b2f3db42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.574274 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf852bba-2e40-4716-804a-1229b2f3db42 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.574557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf852bba-2e40-4716-804a-1229b2f3db42 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.575269 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf852bba-2e40-4716-804a-1229b2f3db42 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.576209 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf852bba-2e40-4716-804a-1229b2f3db42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:18.576516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf852bba-2e40-4716-804a-1229b2f3db42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:18.579446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf852bba-2e40-4716-804a-1229b2f3db42 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:18.592314 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 104/198] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:18.593369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf852bba-2e40-4716-804a-1229b2f3db42 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:18.638333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1bae0-a363-4763-820e-d9622b99e30b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.677052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b892b-1bd0-4f6f-8bd6-0f66711e8292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.677752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b892b-1bd0-4f6f-8bd6-0f66711e8292 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.678039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b892b-1bd0-4f6f-8bd6-0f66711e8292 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.678313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b892b-1bd0-4f6f-8bd6-0f66711e8292 None admin] PATH_INFO: `/v3/users/bb32924bf545453382632883c5d636dd` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.679478 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b892b-1bd0-4f6f-8bd6-0f66711e8292 None admin] RBAC: Authorizing `identity:get_user(user_id=bb32924bf545453382632883c5d636dd)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:18.680993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b892b-1bd0-4f6f-8bd6-0f66711e8292 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:18.683061 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 95/199] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:18 2022] GET /identity/v3/users/bb32924bf545453382632883c5d636dd => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:18.684033 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b892b-1bd0-4f6f-8bd6-0f66711e8292 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:18.716542 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:18.721787 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf852bba-2e40-4716-804a-1229b2f3db42 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.765842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebae5c-a71d-48a4-96a9-1361a0898ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.766883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebae5c-a71d-48a4-96a9-1361a0898ce9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.767329 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebae5c-a71d-48a4-96a9-1361a0898ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.767851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebae5c-a71d-48a4-96a9-1361a0898ce9 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.769123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebae5c-a71d-48a4-96a9-1361a0898ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:18.770782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebae5c-a71d-48a4-96a9-1361a0898ce9 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:18.772986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 105/200] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:18 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:18.773953 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebae5c-a71d-48a4-96a9-1361a0898ce9 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:18.778805 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:18.808902 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b892b-1bd0-4f6f-8bd6-0f66711e8292 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.849422 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91f2b-d973-4e89-a0f1-3980e27f9e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.850985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91f2b-d973-4e89-a0f1-3980e27f9e2e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.850985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91f2b-d973-4e89-a0f1-3980e27f9e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.850985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91f2b-d973-4e89-a0f1-3980e27f9e2e None admin] PATH_INFO: `/v3/users/f6820c4eaf3f4c5da715bedfd7d16f16` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.852234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da91f2b-d973-4e89-a0f1-3980e27f9e2e None admin] RBAC: Authorizing `identity:get_user(user_id=f6820c4eaf3f4c5da715bedfd7d16f16)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:18.853795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da91f2b-d973-4e89-a0f1-3980e27f9e2e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:18.855787 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 96/201] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:18 2022] GET /identity/v3/users/f6820c4eaf3f4c5da715bedfd7d16f16 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:18.856496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91f2b-d973-4e89-a0f1-3980e27f9e2e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:18.884401 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebae5c-a71d-48a4-96a9-1361a0898ce9 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:18.918992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa0e3-5e9c-4e1b-a257-e3b7c9feb610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:18.919507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa0e3-5e9c-4e1b-a257-e3b7c9feb610 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:18.919783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa0e3-5e9c-4e1b-a257-e3b7c9feb610 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:18.920050 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa0e3-5e9c-4e1b-a257-e3b7c9feb610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:18.986910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:18.999029 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91f2b-d973-4e89-a0f1-3980e27f9e2e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:19.004968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fa0e3-5e9c-4e1b-a257-e3b7c9feb610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:19.006433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fa0e3-5e9c-4e1b-a257-e3b7c9feb610 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:19.009133 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:19.049098 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94b97e-76cc-4760-83d0-08ad2cfaf4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:19.049856 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94b97e-76cc-4760-83d0-08ad2cfaf4ac None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:19.050516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94b97e-76cc-4760-83d0-08ad2cfaf4ac None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:19.050892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94b97e-76cc-4760-83d0-08ad2cfaf4ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:19.052677 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94b97e-76cc-4760-83d0-08ad2cfaf4ac None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=b33daf122f6643588023e9a918ba418b, user.id=bb32924bf545453382632883c5d636dd) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:19.053118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94b97e-76cc-4760-83d0-08ad2cfaf4ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:19.054640 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94b97e-76cc-4760-83d0-08ad2cfaf4ac None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:19.063129 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 97/202] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:18 2022] GET /identity/v3/role_assignments?user.id=bb32924bf545453382632883c5d636dd&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:19.064332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94b97e-76cc-4760-83d0-08ad2cfaf4ac None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:19.145957 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 106/203] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:19.151672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa0e3-5e9c-4e1b-a257-e3b7c9feb610 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:19.198507 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94b97e-76cc-4760-83d0-08ad2cfaf4ac None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:19.241620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e0b4f-1d9d-4ea5-90cc-a101241c0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:19.242402 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e0b4f-1d9d-4ea5-90cc-a101241c0952 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:19.244753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e0b4f-1d9d-4ea5-90cc-a101241c0952 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:19.244753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e0b4f-1d9d-4ea5-90cc-a101241c0952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:19.278329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:19.332408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e0b4f-1d9d-4ea5-90cc-a101241c0952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:19.334101 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e0b4f-1d9d-4ea5-90cc-a101241c0952 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:19.417704 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa0e3-5e9c-4e1b-a257-e3b7c9feb610 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:19.424698 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:19.456660 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 98/204] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e0b4f-1d9d-4ea5-90cc-a101241c0952 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:19.503029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a87f33-5060-461c-b6d5-e0c5397b4911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:19.503912 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87f33-5060-461c-b6d5-e0c5397b4911 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:19.504357 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87f33-5060-461c-b6d5-e0c5397b4911 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:19.504790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87f33-5060-461c-b6d5-e0c5397b4911 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:19.506051 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a87f33-5060-461c-b6d5-e0c5397b4911 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:19.515480 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a87f33-5060-461c-b6d5-e0c5397b4911 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:19.517621 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 107/205] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:19 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:19.521663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:19.523543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a87f33-5060-461c-b6d5-e0c5397b4911 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:19.567536 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e0b4f-1d9d-4ea5-90cc-a101241c0952 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:19.603922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cdaf0-0274-4677-8eb7-d8733e4b07d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:19.604713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cdaf0-0274-4677-8eb7-d8733e4b07d0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:19.604997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cdaf0-0274-4677-8eb7-d8733e4b07d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:19.605277 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cdaf0-0274-4677-8eb7-d8733e4b07d0 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:19.606547 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cdaf0-0274-4677-8eb7-d8733e4b07d0 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:19.608023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cdaf0-0274-4677-8eb7-d8733e4b07d0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:19.610231 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 99/206] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:19 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:19.616087 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cdaf0-0274-4677-8eb7-d8733e4b07d0 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:19.722521 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cdaf0-0274-4677-8eb7-d8733e4b07d0 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:19.747367 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:19.759165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b71c-8f60-4dcf-a678-88a27aa76c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:19.759779 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b71c-8f60-4dcf-a678-88a27aa76c99 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:19.760055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b71c-8f60-4dcf-a678-88a27aa76c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:19.760321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b71c-8f60-4dcf-a678-88a27aa76c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:19.761048 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b71c-8f60-4dcf-a678-88a27aa76c99 None admin] RBAC: Adding query filter params (role.id=6cbe97afa726447d8f6888e2faddeea4, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a, user.id=f6820c4eaf3f4c5da715bedfd7d16f16) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:19.761353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b71c-8f60-4dcf-a678-88a27aa76c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:19.762787 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b71c-8f60-4dcf-a678-88a27aa76c99 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:19.769540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 100/207] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:19 2022] GET /identity/v3/role_assignments?user.id=f6820c4eaf3f4c5da715bedfd7d16f16&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=6cbe97afa726447d8f6888e2faddeea4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:19.794209 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a87f33-5060-461c-b6d5-e0c5397b4911 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:19.831113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc624b-ba53-4afc-82b9-2131f45adfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:19.831749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc624b-ba53-4afc-82b9-2131f45adfdb None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:19.832035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc624b-ba53-4afc-82b9-2131f45adfdb None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:19.832314 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc624b-ba53-4afc-82b9-2131f45adfdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:19.833062 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc624b-ba53-4afc-82b9-2131f45adfdb None admin] RBAC: Adding query filter params (role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=b33daf122f6643588023e9a918ba418b, user.id=bb32924bf545453382632883c5d636dd) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:19.833374 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc624b-ba53-4afc-82b9-2131f45adfdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:19.834849 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc624b-ba53-4afc-82b9-2131f45adfdb None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:19.841004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 108/208] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:19 2022] GET /identity/v3/role_assignments?user.id=bb32924bf545453382632883c5d636dd&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:20.788599 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50c92f-0ec2-4b68-a420-0b1cf82463fa None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:20.789210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50c92f-0ec2-4b68-a420-0b1cf82463fa None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:20.789210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50c92f-0ec2-4b68-a420-0b1cf82463fa None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:20.790495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 109/209] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:20.792045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a36c4-0ed2-4776-8087-f20ee10f186c None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:20.792824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a36c4-0ed2-4776-8087-f20ee10f186c None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:20.793341 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a36c4-0ed2-4776-8087-f20ee10f186c None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:20.795168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 101/210] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:20.797394 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5fee-f42e-4c68-93d9-39d8a05256b7 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:20.797901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5fee-f42e-4c68-93d9-39d8a05256b7 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:20.798320 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5fee-f42e-4c68-93d9-39d8a05256b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:20.802224 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8316fb6-5095-4943-b607-7efd5574d6a5 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:20.802659 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8316fb6-5095-4943-b607-7efd5574d6a5 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:20.803104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8316fb6-5095-4943-b607-7efd5574d6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:20.819169 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-64fb5fee-f42e-4c68-93d9-39d8a05256b7 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:20.820581 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-64fb5fee-f42e-4c68-93d9-39d8a05256b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:20.822902 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-d8316fb6-5095-4943-b607-7efd5574d6a5 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:20.824622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-d8316fb6-5095-4943-b607-7efd5574d6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:20.852655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:20.900284 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 110/211] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:20.912095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 102/212] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:21.179494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb5fee-f42e-4c68-93d9-39d8a05256b7 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:21.180815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8316fb6-5095-4943-b607-7efd5574d6a5 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:21.305825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8316fb6-5095-4943-b607-7efd5574d6a5 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:21.310049 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb5fee-f42e-4c68-93d9-39d8a05256b7 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:21.324989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:21.344620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30e916-6e0f-4f61-88da-bdbb63b19a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:21.345128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30e916-6e0f-4f61-88da-bdbb63b19a80 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:21.345409 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30e916-6e0f-4f61-88da-bdbb63b19a80 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:21.345684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30e916-6e0f-4f61-88da-bdbb63b19a80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:21.346824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30e916-6e0f-4f61-88da-bdbb63b19a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:21.348247 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30e916-6e0f-4f61-88da-bdbb63b19a80 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:21.349972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 103/213] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:21.355244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30e916-6e0f-4f61-88da-bdbb63b19a80 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:21.356662 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f55a6a-1947-4490-a37b-e200dc155313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:21.357556 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f55a6a-1947-4490-a37b-e200dc155313 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:21.358279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f55a6a-1947-4490-a37b-e200dc155313 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:21.359818 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f55a6a-1947-4490-a37b-e200dc155313 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:21.373769 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f55a6a-1947-4490-a37b-e200dc155313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-d2f55a6a-1947-4490-a37b-e200dc155313 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:21.380851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:21.381731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:21.382507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:21.384186 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 111/214] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:21.389907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f55a6a-1947-4490-a37b-e200dc155313 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:21.422841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:21.464625 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30e916-6e0f-4f61-88da-bdbb63b19a80 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:21.498546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae51f8-9e1b-4b64-8c1a-08dca1cbdffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:21.499189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae51f8-9e1b-4b64-8c1a-08dca1cbdffa None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:21.499498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae51f8-9e1b-4b64-8c1a-08dca1cbdffa None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:21.499598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f55a6a-1947-4490-a37b-e200dc155313 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:21.499770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae51f8-9e1b-4b64-8c1a-08dca1cbdffa None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:21.500600 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae51f8-9e1b-4b64-8c1a-08dca1cbdffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:21.502022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae51f8-9e1b-4b64-8c1a-08dca1cbdffa None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:21.525731 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 104/215] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:21 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 14:38:21.527185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31e08c-dba4-4b64-a9ce-49994f58b073 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:21.527410 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31e08c-dba4-4b64-a9ce-49994f58b073 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:21.527641 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31e08c-dba4-4b64-a9ce-49994f58b073 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:21.529339 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 105/216] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:21.534982 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fcee5-cfd5-4e1c-8d77-96d9aebd2bd6 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:21.535474 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fcee5-cfd5-4e1c-8d77-96d9aebd2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:21.535752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fcee5-cfd5-4e1c-8d77-96d9aebd2bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:21.554074 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea6198-571a-480f-ae25-3f0e2a997357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:21.555121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea6198-571a-480f-ae25-3f0e2a997357 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:21.555732 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea6198-571a-480f-ae25-3f0e2a997357 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:21.556235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea6198-571a-480f-ae25-3f0e2a997357 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:21.557223 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea6198-571a-480f-ae25-3f0e2a997357 None admin] RBAC: Adding query filter params (name=member) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:21.557443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-242fcee5-cfd5-4e1c-8d77-96d9aebd2bd6 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:21.557963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea6198-571a-480f-ae25-3f0e2a997357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:21.558629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-242fcee5-cfd5-4e1c-8d77-96d9aebd2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:21.560111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea6198-571a-480f-ae25-3f0e2a997357 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:21.572734 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 112/217] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:21.579203 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea6198-571a-480f-ae25-3f0e2a997357 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:21.633130 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:21.648391 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 106/218] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:21.698926 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:21.714628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea6198-571a-480f-ae25-3f0e2a997357 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:21.752070 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15823cfb-5a92-498b-b3c2-45b89d50fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:21.752766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15823cfb-5a92-498b-b3c2-45b89d50fc3d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:21.753054 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15823cfb-5a92-498b-b3c2-45b89d50fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:21.753331 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15823cfb-5a92-498b-b3c2-45b89d50fc3d None admin] PATH_INFO: `/v3/users/c364bb2f1e694a2a93b6a0034156c43e` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:21.767933 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15823cfb-5a92-498b-b3c2-45b89d50fc3d None admin] RBAC: Authorizing `identity:get_user(user_id=c364bb2f1e694a2a93b6a0034156c43e)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:21.769408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15823cfb-5a92-498b-b3c2-45b89d50fc3d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:21.771262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 113/219] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:21 2022] GET /identity/v3/users/c364bb2f1e694a2a93b6a0034156c43e => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:21.776604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fcee5-cfd5-4e1c-8d77-96d9aebd2bd6 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:21.894702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fcee5-cfd5-4e1c-8d77-96d9aebd2bd6 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:21.931652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15823cfb-5a92-498b-b3c2-45b89d50fc3d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:21.940312 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75001bee-460a-46b4-816a-1d660288019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:21.940945 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001bee-460a-46b4-816a-1d660288019a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:21.941220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001bee-460a-46b4-816a-1d660288019a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:21.941490 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75001bee-460a-46b4-816a-1d660288019a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:21.994605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.037151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75001bee-460a-46b4-816a-1d660288019a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:22.038858 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75001bee-460a-46b4-816a-1d660288019a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:22.086927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15823cfb-5a92-498b-b3c2-45b89d50fc3d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:22.135580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed537c32-302f-4768-ab65-953b2df48fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:22.136429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed537c32-302f-4768-ab65-953b2df48fae None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:22.136801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed537c32-302f-4768-ab65-953b2df48fae None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:22.137210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed537c32-302f-4768-ab65-953b2df48fae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:22.154080 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed537c32-302f-4768-ab65-953b2df48fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-ed537c32-302f-4768-ab65-953b2df48fae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:22.159625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:22.160539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:22.161324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 114/220] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:22.162497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18c6af-bb24-4709-8397-e852849ba98e None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:22.162497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18c6af-bb24-4709-8397-e852849ba98e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:22.162761 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18c6af-bb24-4709-8397-e852849ba98e None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:22.168976 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 115/221] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:22.169764 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18c6af-bb24-4709-8397-e852849ba98e None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:22.180039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 107/222] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:22.181464 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.184010 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0b88-5f79-4084-bf2a-c3dd9fc34e76 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:22.184735 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0b88-5f79-4084-bf2a-c3dd9fc34e76 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:22.186176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0b88-5f79-4084-bf2a-c3dd9fc34e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:22.210739 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-c3ec0b88-5f79-4084-bf2a-c3dd9fc34e76 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:22.213502 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-c3ec0b88-5f79-4084-bf2a-c3dd9fc34e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:22.284757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18c6af-bb24-4709-8397-e852849ba98e None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:22.304958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 108/223] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:22.306105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0b88-5f79-4084-bf2a-c3dd9fc34e76 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:22.309470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.337075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e88a18-fb29-4d94-b581-8a9552213381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:22.338139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e88a18-fb29-4d94-b581-8a9552213381 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:22.338424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e88a18-fb29-4d94-b581-8a9552213381 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:22.338695 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e88a18-fb29-4d94-b581-8a9552213381 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:22.339672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e88a18-fb29-4d94-b581-8a9552213381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:22.340031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e88a18-fb29-4d94-b581-8a9552213381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:22.342097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e88a18-fb29-4d94-b581-8a9552213381 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:22.355957 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 116/224] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:22.363966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e88a18-fb29-4d94-b581-8a9552213381 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:22.441119 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0b88-5f79-4084-bf2a-c3dd9fc34e76 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:22.503952 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.506294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab15ece-8095-46f7-8a02-ba6876c4fd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:22.508168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab15ece-8095-46f7-8a02-ba6876c4fd17 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:22.508789 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab15ece-8095-46f7-8a02-ba6876c4fd17 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:22.509074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab15ece-8095-46f7-8a02-ba6876c4fd17 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:22.512044 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab15ece-8095-46f7-8a02-ba6876c4fd17 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:22.513479 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab15ece-8095-46f7-8a02-ba6876c4fd17 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:22.517299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 109/225] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:22 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:22.529338 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab15ece-8095-46f7-8a02-ba6876c4fd17 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:22.579197 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e88a18-fb29-4d94-b581-8a9552213381 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:22.616016 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.620830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc80aec-c56f-495f-82cc-a08e9ff30eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:22.621478 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc80aec-c56f-495f-82cc-a08e9ff30eae None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:22.621758 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc80aec-c56f-495f-82cc-a08e9ff30eae None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:22.622033 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc80aec-c56f-495f-82cc-a08e9ff30eae None admin] PATH_INFO: `/v3/users/bb32924bf545453382632883c5d636dd` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:22.623278 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc80aec-c56f-495f-82cc-a08e9ff30eae None admin] RBAC: Authorizing `identity:get_user(user_id=bb32924bf545453382632883c5d636dd)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:22.626188 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc80aec-c56f-495f-82cc-a08e9ff30eae None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:22.628239 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 117/226] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:22 2022] GET /identity/v3/users/bb32924bf545453382632883c5d636dd => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:22.633334 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc80aec-c56f-495f-82cc-a08e9ff30eae None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:22.650989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab15ece-8095-46f7-8a02-ba6876c4fd17 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:22.685826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2739b-31d2-4c14-b956-5a14930f5697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:22.686481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2739b-31d2-4c14-b956-5a14930f5697 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:22.687319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2739b-31d2-4c14-b956-5a14930f5697 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:22.687600 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2739b-31d2-4c14-b956-5a14930f5697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:22.688322 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2739b-31d2-4c14-b956-5a14930f5697 None admin] RBAC: Adding query filter params (role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=b33daf122f6643588023e9a918ba418b, user.id=c364bb2f1e694a2a93b6a0034156c43e) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:22.688628 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2739b-31d2-4c14-b956-5a14930f5697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:22.690044 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2739b-31d2-4c14-b956-5a14930f5697 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:22.696068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 110/227] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:22 2022] GET /identity/v3/role_assignments?user.id=c364bb2f1e694a2a93b6a0034156c43e&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:22.696591 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2739b-31d2-4c14-b956-5a14930f5697 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:22.814906 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2739b-31d2-4c14-b956-5a14930f5697 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:22.845778 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc80aec-c56f-495f-82cc-a08e9ff30eae None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:22.853658 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af2b5e-ce6c-4c98-b726-6459b15a4ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:22.854317 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2b5e-ce6c-4c98-b726-6459b15a4ad3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:22.854602 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2b5e-ce6c-4c98-b726-6459b15a4ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:22.854941 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2b5e-ce6c-4c98-b726-6459b15a4ad3 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:22.856234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af2b5e-ce6c-4c98-b726-6459b15a4ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:22.857878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af2b5e-ce6c-4c98-b726-6459b15a4ad3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:22.859720 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 111/228] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:22 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:22.865773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af2b5e-ce6c-4c98-b726-6459b15a4ad3 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:22.895342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.921496 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d923ce2-9399-423a-82cc-59ba51a9e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:22.922048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d923ce2-9399-423a-82cc-59ba51a9e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:22.922342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d923ce2-9399-423a-82cc-59ba51a9e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:22.922604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d923ce2-9399-423a-82cc-59ba51a9e5e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:22.929539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:22.941113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d923ce2-9399-423a-82cc-59ba51a9e5e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-3d923ce2-9399-423a-82cc-59ba51a9e5e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:22.951400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:22.952283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:22.954096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 118/229] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:22.962981 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d923ce2-9399-423a-82cc-59ba51a9e5e6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:23.073954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af2b5e-ce6c-4c98-b726-6459b15a4ad3 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:23.114387 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d923ce2-9399-423a-82cc-59ba51a9e5e6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:23.138873 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbc7e3-132c-416a-a067-1b1fa77c2f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:23.139643 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbc7e3-132c-416a-a067-1b1fa77c2f3b None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:23.140501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbc7e3-132c-416a-a067-1b1fa77c2f3b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:23.140806 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbc7e3-132c-416a-a067-1b1fa77c2f3b None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b/users/bb32924bf545453382632883c5d636dd/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:23.142859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbc7e3-132c-416a-a067-1b1fa77c2f3b None admin] RBAC: Authorizing `identity:create_grant(project_id=b33daf122f6643588023e9a918ba418b, user_id=bb32924bf545453382632883c5d636dd, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:23.144397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbc7e3-132c-416a-a067-1b1fa77c2f3b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:23.161107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 112/230] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:38:22 2022] PUT /identity/v3/projects/b33daf122f6643588023e9a918ba418b/users/bb32924bf545453382632883c5d636dd/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:23.179989 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2724f-2271-40e8-b63b-26b06a122705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:23.180611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2724f-2271-40e8-b63b-26b06a122705 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:23.180882 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2724f-2271-40e8-b63b-26b06a122705 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:23.181217 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2724f-2271-40e8-b63b-26b06a122705 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:23.181989 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2724f-2271-40e8-b63b-26b06a122705 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:23.182297 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2724f-2271-40e8-b63b-26b06a122705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:23.183775 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2724f-2271-40e8-b63b-26b06a122705 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:23.198857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 119/231] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:23.205361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbc7e3-132c-416a-a067-1b1fa77c2f3b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:23.280654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:23.325934 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbc7e3-132c-416a-a067-1b1fa77c2f3b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:23.363404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0d8ad-5904-438b-898d-db1ffee1ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:23.364064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d8ad-5904-438b-898d-db1ffee1ad06 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:23.364345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d8ad-5904-438b-898d-db1ffee1ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:23.364622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d8ad-5904-438b-898d-db1ffee1ad06 None admin] PATH_INFO: `/v3/users/bb32924bf545453382632883c5d636dd` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:23.365799 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0d8ad-5904-438b-898d-db1ffee1ad06 None admin] RBAC: Authorizing `identity:get_user(user_id=bb32924bf545453382632883c5d636dd)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:23.367303 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0d8ad-5904-438b-898d-db1ffee1ad06 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:23.368984 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 113/232] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:23 2022] GET /identity/v3/users/bb32924bf545453382632883c5d636dd => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:23.375702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2724f-2271-40e8-b63b-26b06a122705 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:23.440649 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:23.498539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2724f-2271-40e8-b63b-26b06a122705 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:23.538153 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa01db7-df50-45dd-b16f-20263f9c397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:23.538791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa01db7-df50-45dd-b16f-20263f9c397f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:23.539111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa01db7-df50-45dd-b16f-20263f9c397f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:23.539389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa01db7-df50-45dd-b16f-20263f9c397f None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:23.540508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa01db7-df50-45dd-b16f-20263f9c397f None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:23.541932 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa01db7-df50-45dd-b16f-20263f9c397f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:23.543607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 120/233] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:23 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:23.550267 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0d8ad-5904-438b-898d-db1ffee1ad06 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:23.716635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0d8ad-5904-438b-898d-db1ffee1ad06 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:23.768479 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:23.775032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3fae-85a5-46fe-8c3e-4d35e9ff20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:23.775707 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3fae-85a5-46fe-8c3e-4d35e9ff20a8 None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:23.775989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3fae-85a5-46fe-8c3e-4d35e9ff20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:23.776414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3fae-85a5-46fe-8c3e-4d35e9ff20a8 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b/users/bb32924bf545453382632883c5d636dd/roles/44e0a79b0d8942bbb803f5a4cb669d6e` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:23.779157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3fae-85a5-46fe-8c3e-4d35e9ff20a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b33daf122f6643588023e9a918ba418b, user_id=bb32924bf545453382632883c5d636dd, role_id=44e0a79b0d8942bbb803f5a4cb669d6e)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:23.781166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3fae-85a5-46fe-8c3e-4d35e9ff20a8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:23.808020 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 114/234] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:38:23 2022] PUT /identity/v3/projects/b33daf122f6643588023e9a918ba418b/users/bb32924bf545453382632883c5d636dd/roles/44e0a79b0d8942bbb803f5a4cb669d6e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:24.467068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4471cc-35f0-4461-a44a-df01cb12ab51 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:24.467068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4471cc-35f0-4461-a44a-df01cb12ab51 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:24.467068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4471cc-35f0-4461-a44a-df01cb12ab51 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:24.467068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 121/235] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:24.474936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80db28-1806-4b19-8289-c4e8c184f84e None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:24.475919 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80db28-1806-4b19-8289-c4e8c184f84e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:24.476391 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80db28-1806-4b19-8289-c4e8c184f84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:24.500637 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-6b80db28-1806-4b19-8289-c4e8c184f84e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:24.502150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-6b80db28-1806-4b19-8289-c4e8c184f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:24.588896 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 115/236] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:24.643299 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118f86-8267-47ec-82c4-c0932e83c035 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:24.643599 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118f86-8267-47ec-82c4-c0932e83c035 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:24.643858 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33118f86-8267-47ec-82c4-c0932e83c035 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:24.645488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 122/237] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:24.650906 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779eb86-5654-45a0-a9a3-607b7a96f95b None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:24.651473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779eb86-5654-45a0-a9a3-607b7a96f95b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:24.651941 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779eb86-5654-45a0-a9a3-607b7a96f95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:24.679881 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-b779eb86-5654-45a0-a9a3-607b7a96f95b None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:24.681365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-b779eb86-5654-45a0-a9a3-607b7a96f95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:24.756156 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 116/238] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:25.040283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118f86-8267-47ec-82c4-c0932e83c035 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:25.194474 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33118f86-8267-47ec-82c4-c0932e83c035 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:25.224657 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:25.234363 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390b99f-445a-4d47-9351-cd407ad68bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:25.235136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390b99f-445a-4d47-9351-cd407ad68bc9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:25.235421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390b99f-445a-4d47-9351-cd407ad68bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:25.235697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390b99f-445a-4d47-9351-cd407ad68bc9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:25.251802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390b99f-445a-4d47-9351-cd407ad68bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-6390b99f-445a-4d47-9351-cd407ad68bc9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:25.256724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:25.257639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:25.258800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 123/239] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:25.264389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779eb86-5654-45a0-a9a3-607b7a96f95b None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:25.280419 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390b99f-445a-4d47-9351-cd407ad68bc9 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:25.371500 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:25.465276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779eb86-5654-45a0-a9a3-607b7a96f95b None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:25.477066 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390b99f-445a-4d47-9351-cd407ad68bc9 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:25.519871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db9238-b0f9-41b5-84c2-f5a88f3ea4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:25.520517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9238-b0f9-41b5-84c2-f5a88f3ea4f2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:25.520764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9238-b0f9-41b5-84c2-f5a88f3ea4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:25.521036 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9238-b0f9-41b5-84c2-f5a88f3ea4f2 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:25.521698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db9238-b0f9-41b5-84c2-f5a88f3ea4f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:25.521999 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db9238-b0f9-41b5-84c2-f5a88f3ea4f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:25.523393 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db9238-b0f9-41b5-84c2-f5a88f3ea4f2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:25.528686 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d674a-a9ca-4e47-aabc-685d9d957b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:25.529564 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d674a-a9ca-4e47-aabc-685d9d957b41 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:25.530037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d674a-a9ca-4e47-aabc-685d9d957b41 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:25.530618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d674a-a9ca-4e47-aabc-685d9d957b41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:25.531966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d674a-a9ca-4e47-aabc-685d9d957b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:25.533022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 117/240] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:25.534025 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cc09d-1f23-4290-a1f6-f8b3b9f80c63 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:25.534310 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cc09d-1f23-4290-a1f6-f8b3b9f80c63 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:25.534586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cc09d-1f23-4290-a1f6-f8b3b9f80c63 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:25.534869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d674a-a9ca-4e47-aabc-685d9d957b41 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:25.535815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 118/241] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:25.536958 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 124/242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:25.540943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b109-c4f6-43d9-b7bb-06aa550046bc None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:25.541253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b109-c4f6-43d9-b7bb-06aa550046bc None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:25.541494 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b109-c4f6-43d9-b7bb-06aa550046bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:25.542718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d674a-a9ca-4e47-aabc-685d9d957b41 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:25.561092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-e285b109-c4f6-43d9-b7bb-06aa550046bc None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:25.562825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-e285b109-c4f6-43d9-b7bb-06aa550046bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:25.601574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:25.644467 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 119/243] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:25.645432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b109-c4f6-43d9-b7bb-06aa550046bc None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:25.650805 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d674a-a9ca-4e47-aabc-685d9d957b41 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:25.685246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bb278-f0de-49d6-bdfe-1440208e83c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:25.686222 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bb278-f0de-49d6-bdfe-1440208e83c7 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:25.687264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bb278-f0de-49d6-bdfe-1440208e83c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:25.687734 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bb278-f0de-49d6-bdfe-1440208e83c7 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:25.688598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bb278-f0de-49d6-bdfe-1440208e83c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:25.690231 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bb278-f0de-49d6-bdfe-1440208e83c7 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:25.701431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:25.714808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 125/244] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:25 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:25.773173 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b109-c4f6-43d9-b7bb-06aa550046bc None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:25.811248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd8f6c-d95d-4b81-96a1-38a20002bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:25.811917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd8f6c-d95d-4b81-96a1-38a20002bbbb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:25.812198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd8f6c-d95d-4b81-96a1-38a20002bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:25.812472 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd8f6c-d95d-4b81-96a1-38a20002bbbb None admin] PATH_INFO: `/v3/users/cabebc80479943279734c642353d579c` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:25.827447 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd8f6c-d95d-4b81-96a1-38a20002bbbb None admin] RBAC: Authorizing `identity:get_user(user_id=cabebc80479943279734c642353d579c)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:25.829060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd8f6c-d95d-4b81-96a1-38a20002bbbb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:25.831114 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 120/245] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:25 2022] GET /identity/v3/users/cabebc80479943279734c642353d579c => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:25.839108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bb278-f0de-49d6-bdfe-1440208e83c7 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:25.883854 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd1f6c-7596-4fbe-a2b0-f237feddeb13 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:25.884170 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd1f6c-7596-4fbe-a2b0-f237feddeb13 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:25.884416 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd1f6c-7596-4fbe-a2b0-f237feddeb13 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:25.885733 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 121/246] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:25.891681 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113177-4e86-4f69-83a1-52a1106064cb None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:25.891964 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113177-4e86-4f69-83a1-52a1106064cb None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:25.892236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24113177-4e86-4f69-83a1-52a1106064cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:25.919682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-24113177-4e86-4f69-83a1-52a1106064cb None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:25.920816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-24113177-4e86-4f69-83a1-52a1106064cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:26.011289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bb278-f0de-49d6-bdfe-1440208e83c7 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:26.025494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:26.044929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 122/247] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:26.045790 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113177-4e86-4f69-83a1-52a1106064cb None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:26.067427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34440b3f-82d0-46ba-9135-3510c09c0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:26.068148 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34440b3f-82d0-46ba-9135-3510c09c0934 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:26.068518 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34440b3f-82d0-46ba-9135-3510c09c0934 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:26.068894 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34440b3f-82d0-46ba-9135-3510c09c0934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:26.083895 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:26.172190 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34440b3f-82d0-46ba-9135-3510c09c0934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:26.174769 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34440b3f-82d0-46ba-9135-3510c09c0934 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:26.184622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24113177-4e86-4f69-83a1-52a1106064cb None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:26.234937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ae770-5479-4062-9e3c-33e072ee8094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:26.235894 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae770-5479-4062-9e3c-33e072ee8094 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:26.236663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae770-5479-4062-9e3c-33e072ee8094 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:26.237495 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ae770-5479-4062-9e3c-33e072ee8094 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:26.255021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ae770-5479-4062-9e3c-33e072ee8094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-660ae770-5479-4062-9e3c-33e072ee8094 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:26.260942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:26.261810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:26.262615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:26.267866 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 123/248] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:26.276203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ae770-5479-4062-9e3c-33e072ee8094 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:26.323923 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 126/249] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:26.329878 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34440b3f-82d0-46ba-9135-3510c09c0934 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:26.344692 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:26.398993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:26.417286 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ae770-5479-4062-9e3c-33e072ee8094 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:26.455791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34440b3f-82d0-46ba-9135-3510c09c0934 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:26.464680 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f381e-26a3-44fa-8ea4-e9173bbe9090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:26.465618 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f381e-26a3-44fa-8ea4-e9173bbe9090 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:26.466090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f381e-26a3-44fa-8ea4-e9173bbe9090 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:26.466363 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f381e-26a3-44fa-8ea4-e9173bbe9090 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:26.467165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f381e-26a3-44fa-8ea4-e9173bbe9090 None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:26.467470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f381e-26a3-44fa-8ea4-e9173bbe9090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:26.469584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f381e-26a3-44fa-8ea4-e9173bbe9090 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:26.480415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 124/250] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:26.480653 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f381e-26a3-44fa-8ea4-e9173bbe9090 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:26.497640 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80b025-af07-4b6a-a040-a72dd8bf2b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:26.498500 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80b025-af07-4b6a-a040-a72dd8bf2b93 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:26.498783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80b025-af07-4b6a-a040-a72dd8bf2b93 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:26.499089 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80b025-af07-4b6a-a040-a72dd8bf2b93 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:26.501572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80b025-af07-4b6a-a040-a72dd8bf2b93 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:26.503480 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80b025-af07-4b6a-a040-a72dd8bf2b93 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:26.505112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 127/251] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:26 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:26.505867 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80b025-af07-4b6a-a040-a72dd8bf2b93 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:26.602795 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:26.605697 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f381e-26a3-44fa-8ea4-e9173bbe9090 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:26.628361 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80b025-af07-4b6a-a040-a72dd8bf2b93 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:26.647677 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b5cd1-0bf5-47a8-9df8-883ea84febfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:26.648631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5cd1-0bf5-47a8-9df8-883ea84febfd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:26.648930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5cd1-0bf5-47a8-9df8-883ea84febfd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:26.649206 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5cd1-0bf5-47a8-9df8-883ea84febfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:26.663390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b5cd1-0bf5-47a8-9df8-883ea84febfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:26.667493 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e647-53a1-4477-b05c-6e97940535b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:26.668247 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e647-53a1-4477-b05c-6e97940535b8 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:26.668626 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e647-53a1-4477-b05c-6e97940535b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:26.669028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e647-53a1-4477-b05c-6e97940535b8 None admin] PATH_INFO: `/v3/users/c364bb2f1e694a2a93b6a0034156c43e` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-ac2b5cd1-0bf5-47a8-9df8-883ea84febfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:26.669435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:26.670486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:26.671589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 125/252] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:26.672408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b5cd1-0bf5-47a8-9df8-883ea84febfd None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:26.673432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8e647-53a1-4477-b05c-6e97940535b8 None admin] RBAC: Authorizing `identity:get_user(user_id=c364bb2f1e694a2a93b6a0034156c43e)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:26.674855 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8e647-53a1-4477-b05c-6e97940535b8 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:26.677655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 128/253] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:26 2022] GET /identity/v3/users/c364bb2f1e694a2a93b6a0034156c43e => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:26.678770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e647-53a1-4477-b05c-6e97940535b8 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:26.694512 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:26.820555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e647-53a1-4477-b05c-6e97940535b8 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:26.856628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bdac6-ee83-4099-903d-704fc4304bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:26.857248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bdac6-ee83-4099-903d-704fc4304bd6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:26.857532 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bdac6-ee83-4099-903d-704fc4304bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:26.857811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bdac6-ee83-4099-903d-704fc4304bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:26.862973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bdac6-ee83-4099-903d-704fc4304bd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:26.862973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bdac6-ee83-4099-903d-704fc4304bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:26.862973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bdac6-ee83-4099-903d-704fc4304bd6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:26.869784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 129/254] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:26.870921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bdac6-ee83-4099-903d-704fc4304bd6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:26.882070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b5cd1-0bf5-47a8-9df8-883ea84febfd None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:26.886904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:26.928269 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bd113-48f3-4b06-b2d2-516328cbbe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:26.928881 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bd113-48f3-4b06-b2d2-516328cbbe2f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:26.929163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bd113-48f3-4b06-b2d2-516328cbbe2f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:26.929438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bd113-48f3-4b06-b2d2-516328cbbe2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:26.930163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bd113-48f3-4b06-b2d2-516328cbbe2f None admin] RBAC: Adding query filter params (role.id=6cbe97afa726447d8f6888e2faddeea4, scope.project.id=b33daf122f6643588023e9a918ba418b, user.id=cabebc80479943279734c642353d579c) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:26.930757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bd113-48f3-4b06-b2d2-516328cbbe2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:26.932888 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bd113-48f3-4b06-b2d2-516328cbbe2f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:26.940878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 126/255] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:26 2022] GET /identity/v3/role_assignments?user.id=cabebc80479943279734c642353d579c&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=6cbe97afa726447d8f6888e2faddeea4 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:26.941959 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bd113-48f3-4b06-b2d2-516328cbbe2f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:27.036296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bdac6-ee83-4099-903d-704fc4304bd6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:27.118485 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03ba8a-c83e-48dc-89f4-bf45ae02bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:27.119797 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ba8a-c83e-48dc-89f4-bf45ae02bc18 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:27.121498 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ba8a-c83e-48dc-89f4-bf45ae02bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:27.121498 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ba8a-c83e-48dc-89f4-bf45ae02bc18 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:27.122100 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03ba8a-c83e-48dc-89f4-bf45ae02bc18 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:27.123532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:27.123981 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03ba8a-c83e-48dc-89f4-bf45ae02bc18 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:27.126703 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 130/256] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:26 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:27.128200 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99278b-b05b-4d5b-96a9-7af364af5681 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:27.128482 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99278b-b05b-4d5b-96a9-7af364af5681 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:27.128757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99278b-b05b-4d5b-96a9-7af364af5681 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:27.130145 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 131/257] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:27.135651 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99278b-b05b-4d5b-96a9-7af364af5681 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:27.160914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bd113-48f3-4b06-b2d2-516328cbbe2f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:27.222284 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416c7eb-43e1-4bbc-ab82-589f34923f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:27.223008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416c7eb-43e1-4bbc-ab82-589f34923f66 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:27.223296 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416c7eb-43e1-4bbc-ab82-589f34923f66 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:27.223572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416c7eb-43e1-4bbc-ab82-589f34923f66 None admin] PATH_INFO: `/v3/users/bb32924bf545453382632883c5d636dd` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:27.226741 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416c7eb-43e1-4bbc-ab82-589f34923f66 None admin] RBAC: Authorizing `identity:get_user(user_id=bb32924bf545453382632883c5d636dd)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:27.228332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416c7eb-43e1-4bbc-ab82-589f34923f66 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:27.230275 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 127/258] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:26 2022] GET /identity/v3/users/bb32924bf545453382632883c5d636dd => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:27.231371 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93c46b-446f-4380-8ac6-991f749d5f1f None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:27.231650 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93c46b-446f-4380-8ac6-991f749d5f1f None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:27.231925 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93c46b-446f-4380-8ac6-991f749d5f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:27.233109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:27.270179 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-2d93c46b-446f-4380-8ac6-991f749d5f1f None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:27.271394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-2d93c46b-446f-4380-8ac6-991f749d5f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:27.287552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99278b-b05b-4d5b-96a9-7af364af5681 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:27.335832 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fbaed-d551-48b1-ad05-6af470f699bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:27.336718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fbaed-d551-48b1-ad05-6af470f699bd None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:27.337110 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fbaed-d551-48b1-ad05-6af470f699bd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:27.337393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fbaed-d551-48b1-ad05-6af470f699bd None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b/users/c364bb2f1e694a2a93b6a0034156c43e/roles/5039147f7bed444380ba0a7d7b6c2269` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:27.339297 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fbaed-d551-48b1-ad05-6af470f699bd None admin] RBAC: Authorizing `identity:create_grant(project_id=b33daf122f6643588023e9a918ba418b, user_id=c364bb2f1e694a2a93b6a0034156c43e, role_id=5039147f7bed444380ba0a7d7b6c2269)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:27.340939 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fbaed-d551-48b1-ad05-6af470f699bd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:27.362748 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 132/259] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:38:27 2022] PUT /identity/v3/projects/b33daf122f6643588023e9a918ba418b/users/c364bb2f1e694a2a93b6a0034156c43e/roles/5039147f7bed444380ba0a7d7b6c2269 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 14:38:27.368273 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fbaed-d551-48b1-ad05-6af470f699bd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:27.447670 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 128/260] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:27.531332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fbaed-d551-48b1-ad05-6af470f699bd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:27.570136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675ce99-bf0e-4e28-9c13-f0d13d4790e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:27.570832 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675ce99-bf0e-4e28-9c13-f0d13d4790e6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:27.571138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675ce99-bf0e-4e28-9c13-f0d13d4790e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:27.571410 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675ce99-bf0e-4e28-9c13-f0d13d4790e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:27.575368 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:27.657897 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675ce99-bf0e-4e28-9c13-f0d13d4790e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:27.659294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675ce99-bf0e-4e28-9c13-f0d13d4790e6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:27.775979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 133/261] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:27.781990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93c46b-446f-4380-8ac6-991f749d5f1f None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:27.870690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:27.898569 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93c46b-446f-4380-8ac6-991f749d5f1f None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:27.931914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675ce99-bf0e-4e28-9c13-f0d13d4790e6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:27.938030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ea445-3782-4377-b6b3-c605c85df0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:27.938592 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ea445-3782-4377-b6b3-c605c85df0e8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:27.938959 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ea445-3782-4377-b6b3-c605c85df0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:27.939163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ea445-3782-4377-b6b3-c605c85df0e8 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:27.940304 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ea445-3782-4377-b6b3-c605c85df0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:27.941747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ea445-3782-4377-b6b3-c605c85df0e8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:27.943415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 129/262] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:27 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:27.949165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ea445-3782-4377-b6b3-c605c85df0e8 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:28.008049 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:28.056366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ea445-3782-4377-b6b3-c605c85df0e8 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:28.091996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f966bbd-8525-4543-87a4-7e6f7b18e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:28.096097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f966bbd-8525-4543-87a4-7e6f7b18e20b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:28.096097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f966bbd-8525-4543-87a4-7e6f7b18e20b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:28.096097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f966bbd-8525-4543-87a4-7e6f7b18e20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:28.096097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f966bbd-8525-4543-87a4-7e6f7b18e20b None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=b33daf122f6643588023e9a918ba418b, user.id=bb32924bf545453382632883c5d636dd) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:28.096097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f966bbd-8525-4543-87a4-7e6f7b18e20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:28.096447 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f966bbd-8525-4543-87a4-7e6f7b18e20b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:28.106975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 130/263] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:27 2022] GET /identity/v3/role_assignments?user.id=bb32924bf545453382632883c5d636dd&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:28.151124 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675ce99-bf0e-4e28-9c13-f0d13d4790e6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:28.214030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ef08f-6f1b-4c86-af6c-59d2dd4a01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:28.214607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ef08f-6f1b-4c86-af6c-59d2dd4a01c1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:28.214888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ef08f-6f1b-4c86-af6c-59d2dd4a01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:28.215189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ef08f-6f1b-4c86-af6c-59d2dd4a01c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:28.236060 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ef08f-6f1b-4c86-af6c-59d2dd4a01c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-885ef08f-6f1b-4c86-af6c-59d2dd4a01c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:28.241192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:28.242111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:28.242906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 134/264] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:38:28.248618 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f966bbd-8525-4543-87a4-7e6f7b18e20b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:28.263519 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:28.392459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f966bbd-8525-4543-87a4-7e6f7b18e20b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:28.440198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6daa0d-0a84-4075-b327-79f8cde3a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:28.440821 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6daa0d-0a84-4075-b327-79f8cde3a436 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:28.441103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6daa0d-0a84-4075-b327-79f8cde3a436 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:28.441373 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6daa0d-0a84-4075-b327-79f8cde3a436 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:28.442038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6daa0d-0a84-4075-b327-79f8cde3a436 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:28.442346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6daa0d-0a84-4075-b327-79f8cde3a436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:28.443748 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6daa0d-0a84-4075-b327-79f8cde3a436 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:28.461309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 131/265] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:28.466776 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ef08f-6f1b-4c86-af6c-59d2dd4a01c1 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:28.572618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:28.580746 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ef08f-6f1b-4c86-af6c-59d2dd4a01c1 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:28.622394 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c34b4a-4197-417d-90fd-51687e414ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:28.623056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c34b4a-4197-417d-90fd-51687e414ff3 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:28.623345 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c34b4a-4197-417d-90fd-51687e414ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:28.623623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c34b4a-4197-417d-90fd-51687e414ff3 None admin] PATH_INFO: `/v3/users/bb32924bf545453382632883c5d636dd` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:28.625291 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c34b4a-4197-417d-90fd-51687e414ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=bb32924bf545453382632883c5d636dd)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:28.626921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c34b4a-4197-417d-90fd-51687e414ff3 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:28.628752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 135/266] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:28 2022] GET /identity/v3/users/bb32924bf545453382632883c5d636dd => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:28.634202 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6daa0d-0a84-4075-b327-79f8cde3a436 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:28.709365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:28.781978 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6daa0d-0a84-4075-b327-79f8cde3a436 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:28.832197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4292eb-2533-4ac0-b7fe-dbe5d77d8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:28.833473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4292eb-2533-4ac0-b7fe-dbe5d77d8010 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:28.833899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4292eb-2533-4ac0-b7fe-dbe5d77d8010 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:28.834314 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4292eb-2533-4ac0-b7fe-dbe5d77d8010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:28.923832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4292eb-2533-4ac0-b7fe-dbe5d77d8010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:28.925520 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4292eb-2533-4ac0-b7fe-dbe5d77d8010 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:29.027133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:29.080016 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 132/267] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:29.086084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c34b4a-4197-417d-90fd-51687e414ff3 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:29.213890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6368-9d18-4c0c-8db8-939df998909c None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:29.214517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6368-9d18-4c0c-8db8-939df998909c None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:29.215021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6368-9d18-4c0c-8db8-939df998909c None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:29.216554 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 133/268] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:29.222107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50801d-4faf-4a8c-9b80-116e0166e0a9 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:29.222608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50801d-4faf-4a8c-9b80-116e0166e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:29.223130 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50801d-4faf-4a8c-9b80-116e0166e0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:29.251936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-de50801d-4faf-4a8c-9b80-116e0166e0a9 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:29.254112 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-de50801d-4faf-4a8c-9b80-116e0166e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:29.276585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c34b4a-4197-417d-90fd-51687e414ff3 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:29.317502 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510595bd-7816-48b0-af0c-cc5f9d90eb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:29.318135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510595bd-7816-48b0-af0c-cc5f9d90eb48 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:29.318416 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510595bd-7816-48b0-af0c-cc5f9d90eb48 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:29.318691 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510595bd-7816-48b0-af0c-cc5f9d90eb48 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:29.319834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510595bd-7816-48b0-af0c-cc5f9d90eb48 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:29.321252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510595bd-7816-48b0-af0c-cc5f9d90eb48 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:29.323139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 136/269] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:29 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:29.324439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16edc48-71de-43b3-bb92-e55b4fb54f47 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:29.324942 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16edc48-71de-43b3-bb92-e55b4fb54f47 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:29.325431 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16edc48-71de-43b3-bb92-e55b4fb54f47 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:29.326909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 137/270] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:29.332488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16edc48-71de-43b3-bb92-e55b4fb54f47 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:29.339090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 134/271] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:29.340461 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fae8e-4418-40e9-ae1f-8faa5275ccd8 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:29.340747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fae8e-4418-40e9-ae1f-8faa5275ccd8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:29.341074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fae8e-4418-40e9-ae1f-8faa5275ccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:29.360916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-1e6fae8e-4418-40e9-ae1f-8faa5275ccd8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:29.362492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-1e6fae8e-4418-40e9-ae1f-8faa5275ccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:29.388127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:29.441805 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 135/272] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:29.507898 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16edc48-71de-43b3-bb92-e55b4fb54f47 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:29.544653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a246-ab10-4070-87f6-420b741d9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:29.545261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a246-ab10-4070-87f6-420b741d9c08 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:29.545541 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a246-ab10-4070-87f6-420b741d9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:29.545815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0a246-ab10-4070-87f6-420b741d9c08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:29.547205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0a246-ab10-4070-87f6-420b741d9c08 None admin] RBAC: Adding query filter params (role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=b33daf122f6643588023e9a918ba418b, user.id=bb32924bf545453382632883c5d636dd) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:29.547517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0a246-ab10-4070-87f6-420b741d9c08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:29.548947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0a246-ab10-4070-87f6-420b741d9c08 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:29.555068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 138/273] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:29 2022] GET /identity/v3/role_assignments?user.id=bb32924bf545453382632883c5d636dd&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:29.775596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fae8e-4418-40e9-ae1f-8faa5275ccd8 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:29.805888 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:29.823296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a246-ab10-4070-87f6-420b741d9c08 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:29.908120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fae8e-4418-40e9-ae1f-8faa5275ccd8 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:29.946414 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:29.958258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0a246-ab10-4070-87f6-420b741d9c08 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:29.961781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af8ad7-3e53-4d81-b3dc-b8851b7bd983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:29.962715 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8ad7-3e53-4d81-b3dc-b8851b7bd983 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:29.963320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8ad7-3e53-4d81-b3dc-b8851b7bd983 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:29.963797 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af8ad7-3e53-4d81-b3dc-b8851b7bd983 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:29.979746 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af8ad7-3e53-4d81-b3dc-b8851b7bd983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-12af8ad7-3e53-4d81-b3dc-b8851b7bd983 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:29.985955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:29.986928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:29.987737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 136/274] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:29.988570 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca744d1-e3f1-4b1f-85c1-c8e2db76ec7c None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:29.988851 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca744d1-e3f1-4b1f-85c1-c8e2db76ec7c None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:29.989265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca744d1-e3f1-4b1f-85c1-c8e2db76ec7c None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:29.991943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 137/275] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:29.997598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246434c-c0bc-44cc-95a7-c2f085d89f4e None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:29.998302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246434c-c0bc-44cc-95a7-c2f085d89f4e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:29.998578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246434c-c0bc-44cc-95a7-c2f085d89f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.000439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e507a-c3ac-40e9-8298-bced9d0dc4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:30.001167 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e507a-c3ac-40e9-8298-bced9d0dc4a2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.001417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e507a-c3ac-40e9-8298-bced9d0dc4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.001677 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e507a-c3ac-40e9-8298-bced9d0dc4a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.003451 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e507a-c3ac-40e9-8298-bced9d0dc4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:30.005303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e507a-c3ac-40e9-8298-bced9d0dc4a2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:30.008592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 139/276] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:30.009590 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e507a-c3ac-40e9-8298-bced9d0dc4a2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:30.024415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-3246434c-c0bc-44cc-95a7-c2f085d89f4e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:30.025870 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-3246434c-c0bc-44cc-95a7-c2f085d89f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:30.107638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 138/277] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:30.110808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246434c-c0bc-44cc-95a7-c2f085d89f4e None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:30.129385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:30.134690 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e507a-c3ac-40e9-8298-bced9d0dc4a2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:30.183264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7419efb-1019-44b1-8c82-8a5a1c10f0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:30.184271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7419efb-1019-44b1-8c82-8a5a1c10f0cd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.184759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7419efb-1019-44b1-8c82-8a5a1c10f0cd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.185475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7419efb-1019-44b1-8c82-8a5a1c10f0cd None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.186396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7419efb-1019-44b1-8c82-8a5a1c10f0cd None admin] RBAC: Adding query filter params (name=member) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:30.187374 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7419efb-1019-44b1-8c82-8a5a1c10f0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:30.188774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7419efb-1019-44b1-8c82-8a5a1c10f0cd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:30.201357 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 140/278] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:30.206951 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7419efb-1019-44b1-8c82-8a5a1c10f0cd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:30.234115 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246434c-c0bc-44cc-95a7-c2f085d89f4e None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:30.238556 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:30.273292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb68ad-5a22-480e-8426-5e500eab6d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:30.274294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb68ad-5a22-480e-8426-5e500eab6d34 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.274811 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb68ad-5a22-480e-8426-5e500eab6d34 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.275301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb68ad-5a22-480e-8426-5e500eab6d34 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.276224 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb68ad-5a22-480e-8426-5e500eab6d34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:30.278209 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb68ad-5a22-480e-8426-5e500eab6d34 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:30.307979 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 139/279] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:30 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:30.322554 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7419efb-1019-44b1-8c82-8a5a1c10f0cd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:30.362724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168a797-c1d7-4f27-a67e-a4890090eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:30.363428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168a797-c1d7-4f27-a67e-a4890090eb72 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.363709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168a797-c1d7-4f27-a67e-a4890090eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.363985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168a797-c1d7-4f27-a67e-a4890090eb72 None admin] PATH_INFO: `/v3/users/279f4b16677540f09558589930596cee` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.380991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168a797-c1d7-4f27-a67e-a4890090eb72 None admin] RBAC: Authorizing `identity:get_user(user_id=279f4b16677540f09558589930596cee)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:30.382563 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168a797-c1d7-4f27-a67e-a4890090eb72 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:30.384628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 141/280] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:30 2022] GET /identity/v3/users/279f4b16677540f09558589930596cee => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:30.390414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb68ad-5a22-480e-8426-5e500eab6d34 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:30.412757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168a797-c1d7-4f27-a67e-a4890090eb72 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:30.489148 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:30.518555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:30.523636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb68ad-5a22-480e-8426-5e500eab6d34 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:30.541528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168a797-c1d7-4f27-a67e-a4890090eb72 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:30.565103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8da0c-b8cb-47d8-9867-a35ebc334157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:30.565720 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8da0c-b8cb-47d8-9867-a35ebc334157 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.566110 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8da0c-b8cb-47d8-9867-a35ebc334157 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.566382 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8da0c-b8cb-47d8-9867-a35ebc334157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.567194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8da0c-b8cb-47d8-9867-a35ebc334157 None admin] RBAC: Adding query filter params (role.id=5039147f7bed444380ba0a7d7b6c2269, user.id=279f4b16677540f09558589930596cee, scope.system=all) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:30.567675 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8da0c-b8cb-47d8-9867-a35ebc334157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:30.569413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8da0c-b8cb-47d8-9867-a35ebc334157 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:30.575538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 140/281] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Oct 3 14:38:30 2022] GET /identity/v3/role_assignments?user.id=279f4b16677540f09558589930596cee&scope.system=all&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:30.584140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ddf5-2341-4ec0-9fa4-92afab21a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:30.585102 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ddf5-2341-4ec0-9fa4-92afab21a09d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.585588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ddf5-2341-4ec0-9fa4-92afab21a09d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.586056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033ddf5-2341-4ec0-9fa4-92afab21a09d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.592628 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280af181-dbc9-4495-84ec-1425d72d5a69 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.593534 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280af181-dbc9-4495-84ec-1425d72d5a69 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.593790 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280af181-dbc9-4495-84ec-1425d72d5a69 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.595495 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 141/282] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:30.599023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033ddf5-2341-4ec0-9fa4-92afab21a09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:30.600756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f50ad4-bb3e-48e5-8263-e382e450f811 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.601117 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f50ad4-bb3e-48e5-8263-e382e450f811 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.601399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f50ad4-bb3e-48e5-8263-e382e450f811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c033ddf5-2341-4ec0-9fa4-92afab21a09d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:30.604888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:30.605815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:30.606597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 142/283] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:38:30.613400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ddf5-2341-4ec0-9fa4-92afab21a09d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:30.632118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-f9f50ad4-bb3e-48e5-8263-e382e450f811 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:30.633871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-f9f50ad4-bb3e-48e5-8263-e382e450f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:30.727960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 142/284] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:30.751433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033ddf5-2341-4ec0-9fa4-92afab21a09d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:30.792520 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afbaa5-96d3-4058-9484-c9e2d3e3f308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:30.793459 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afbaa5-96d3-4058-9484-c9e2d3e3f308 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.793997 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afbaa5-96d3-4058-9484-c9e2d3e3f308 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.794466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afbaa5-96d3-4058-9484-c9e2d3e3f308 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.795371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afbaa5-96d3-4058-9484-c9e2d3e3f308 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:30.796389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afbaa5-96d3-4058-9484-c9e2d3e3f308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:30.797986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afbaa5-96d3-4058-9484-c9e2d3e3f308 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:30.806942 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 143/285] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:30.815012 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f50ad4-bb3e-48e5-8263-e382e450f811 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:30.904727 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:30.948856 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f50ad4-bb3e-48e5-8263-e382e450f811 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:30.989991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758bd6-15cd-4dd2-8d19-03c68f7c089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:30.990625 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758bd6-15cd-4dd2-8d19-03c68f7c089d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:30.990902 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758bd6-15cd-4dd2-8d19-03c68f7c089d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:30.991203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758bd6-15cd-4dd2-8d19-03c68f7c089d None admin] PATH_INFO: `/v3/users/cabebc80479943279734c642353d579c` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:30.992324 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758bd6-15cd-4dd2-8d19-03c68f7c089d None admin] RBAC: Authorizing `identity:get_user(user_id=cabebc80479943279734c642353d579c)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:30.993755 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758bd6-15cd-4dd2-8d19-03c68f7c089d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:30.995936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 143/286] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:30 2022] GET /identity/v3/users/cabebc80479943279734c642353d579c => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:31.004290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afbaa5-96d3-4058-9484-c9e2d3e3f308 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:31.025067 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:31.073394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758bd6-15cd-4dd2-8d19-03c68f7c089d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:31.201210 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758bd6-15cd-4dd2-8d19-03c68f7c089d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:31.212100 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afbaa5-96d3-4058-9484-c9e2d3e3f308 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:31.239488 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265da8a-c467-4f5f-b937-311c70b49982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:31.240747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265da8a-c467-4f5f-b937-311c70b49982 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:31.241620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265da8a-c467-4f5f-b937-311c70b49982 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:31.242099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265da8a-c467-4f5f-b937-311c70b49982 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:31.251288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:31.265510 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265da8a-c467-4f5f-b937-311c70b49982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-2265da8a-c467-4f5f-b937-311c70b49982 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:31.271582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:31.272468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:31.273272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:31.275877 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 144/287] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:31.283981 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265da8a-c467-4f5f-b937-311c70b49982 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:31.285000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f760e-d999-4c89-b97c-14da8c59aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:31.285649 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f760e-d999-4c89-b97c-14da8c59aa54 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:31.285927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f760e-d999-4c89-b97c-14da8c59aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:31.286194 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f760e-d999-4c89-b97c-14da8c59aa54 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:31.289692 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f760e-d999-4c89-b97c-14da8c59aa54 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:31.297424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f760e-d999-4c89-b97c-14da8c59aa54 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:31.299462 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 144/288] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:31 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:31.312441 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f760e-d999-4c89-b97c-14da8c59aa54 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:31.400775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265da8a-c467-4f5f-b937-311c70b49982 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:31.444463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df1cde-b779-4c68-840c-cca9229f6350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:31.445089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df1cde-b779-4c68-840c-cca9229f6350 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:31.445364 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df1cde-b779-4c68-840c-cca9229f6350 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:31.445630 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df1cde-b779-4c68-840c-cca9229f6350 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:31.446293 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df1cde-b779-4c68-840c-cca9229f6350 None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:31.446593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df1cde-b779-4c68-840c-cca9229f6350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:31.453718 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df1cde-b779-4c68-840c-cca9229f6350 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:31.454371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:31.470657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 145/289] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:31.476723 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df1cde-b779-4c68-840c-cca9229f6350 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:31.509742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f760e-d999-4c89-b97c-14da8c59aa54 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:31.579281 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e47450-467f-431e-b58f-75a0d3712a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:31.579947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47450-467f-431e-b58f-75a0d3712a97 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:31.580224 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47450-467f-431e-b58f-75a0d3712a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:31.580498 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e47450-467f-431e-b58f-75a0d3712a97 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b/users/cabebc80479943279734c642353d579c/roles/6cbe97afa726447d8f6888e2faddeea4` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:31.583538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e47450-467f-431e-b58f-75a0d3712a97 None admin] RBAC: Authorizing `identity:create_grant(project_id=b33daf122f6643588023e9a918ba418b, user_id=cabebc80479943279734c642353d579c, role_id=6cbe97afa726447d8f6888e2faddeea4)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:31.584958 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e47450-467f-431e-b58f-75a0d3712a97 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:31.592021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:31.607630 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 145/290] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:38:31 2022] PUT /identity/v3/projects/b33daf122f6643588023e9a918ba418b/users/cabebc80479943279734c642353d579c/roles/6cbe97afa726447d8f6888e2faddeea4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:31.665866 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df1cde-b779-4c68-840c-cca9229f6350 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:31.702639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc81dc-b2b3-4c96-99bb-a231364fc3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:31.703771 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc81dc-b2b3-4c96-99bb-a231364fc3f9 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:31.704287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc81dc-b2b3-4c96-99bb-a231364fc3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:31.704757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc81dc-b2b3-4c96-99bb-a231364fc3f9 None admin] PATH_INFO: `/v3/users/c364bb2f1e694a2a93b6a0034156c43e` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:31.706219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc81dc-b2b3-4c96-99bb-a231364fc3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c364bb2f1e694a2a93b6a0034156c43e)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:31.707916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc81dc-b2b3-4c96-99bb-a231364fc3f9 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:31.709734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 146/291] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:31 2022] GET /identity/v3/users/c364bb2f1e694a2a93b6a0034156c43e => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:31.715576 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e47450-467f-431e-b58f-75a0d3712a97 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:31.853032 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e47450-467f-431e-b58f-75a0d3712a97 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:31.898332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c403d-d703-4dd6-a77e-9c8205700f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:31.899036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c403d-d703-4dd6-a77e-9c8205700f18 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:31.899321 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c403d-d703-4dd6-a77e-9c8205700f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:31.899600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c403d-d703-4dd6-a77e-9c8205700f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:31.902439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:31.976404 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c403d-d703-4dd6-a77e-9c8205700f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:31.977790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c403d-d703-4dd6-a77e-9c8205700f18 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:32.088351 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 146/292] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:32.094560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc81dc-b2b3-4c96-99bb-a231364fc3f9 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:32.232210 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc81dc-b2b3-4c96-99bb-a231364fc3f9 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:32.258788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:32.268342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00317caa-ab1f-4d05-8e2e-56fe4d7226d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:32.268983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00317caa-ab1f-4d05-8e2e-56fe4d7226d1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:32.269265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00317caa-ab1f-4d05-8e2e-56fe4d7226d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:32.269537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00317caa-ab1f-4d05-8e2e-56fe4d7226d1 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:32.270642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00317caa-ab1f-4d05-8e2e-56fe4d7226d1 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:32.272169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00317caa-ab1f-4d05-8e2e-56fe4d7226d1 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:32.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 147/293] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:32 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:32.279881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c403d-d703-4dd6-a77e-9c8205700f18 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:32.329610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:32.420792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c403d-d703-4dd6-a77e-9c8205700f18 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:32.469352 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c6534-02cd-41ad-891d-8049632adcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:32.469958 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6534-02cd-41ad-891d-8049632adcae None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:32.470294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6534-02cd-41ad-891d-8049632adcae None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:32.470572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c6534-02cd-41ad-891d-8049632adcae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:32.471361 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6534-02cd-41ad-891d-8049632adcae None admin] RBAC: Adding query filter params (role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=b33daf122f6643588023e9a918ba418b, user.id=c364bb2f1e694a2a93b6a0034156c43e) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:32.471670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6534-02cd-41ad-891d-8049632adcae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:32.473100 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c6534-02cd-41ad-891d-8049632adcae None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:32.481988 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 147/294] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:32 2022] GET /identity/v3/role_assignments?user.id=c364bb2f1e694a2a93b6a0034156c43e&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:32.992555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce678-c581-4bb6-bbd4-bd0b6bd0f282 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:32.992930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce678-c581-4bb6-bbd4-bd0b6bd0f282 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:32.993126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce678-c581-4bb6-bbd4-bd0b6bd0f282 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:32.994463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 148/295] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:33.000646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46668072-8024-49c5-a645-d6b2212e8da2 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:33.000932 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46668072-8024-49c5-a645-d6b2212e8da2 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:33.001209 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46668072-8024-49c5-a645-d6b2212e8da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:33.025711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-46668072-8024-49c5-a645-d6b2212e8da2 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:33.026910 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-46668072-8024-49c5-a645-d6b2212e8da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:33.117956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 148/296] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:33.344808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11a905-6424-4d73-85ea-53cf653330aa None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:33.345802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11a905-6424-4d73-85ea-53cf653330aa None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:33.346288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11a905-6424-4d73-85ea-53cf653330aa None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:33.348118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 149/297] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:33.350372 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f0c50-969d-4913-a2c7-b8ec4afae7e1 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:33.350918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f0c50-969d-4913-a2c7-b8ec4afae7e1 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:33.351450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f0c50-969d-4913-a2c7-b8ec4afae7e1 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:33.353242 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 149/298] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:33.353730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3677-e685-4cca-8f8a-761692661eba None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:33.354226 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3677-e685-4cca-8f8a-761692661eba None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:33.354713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3677-e685-4cca-8f8a-761692661eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:33.358218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4838-d3b7-4cd3-a33d-17c9588d49cc None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:33.358775 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4838-d3b7-4cd3-a33d-17c9588d49cc None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:33.359282 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4838-d3b7-4cd3-a33d-17c9588d49cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:33.373742 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-695c3677-e685-4cca-8f8a-761692661eba None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:33.375873 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-695c3677-e685-4cca-8f8a-761692661eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:33.378381 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-2d2b4838-d3b7-4cd3-a33d-17c9588d49cc None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:33.379865 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-2d2b4838-d3b7-4cd3-a33d-17c9588d49cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:33.407910 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:33.449672 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 150/299] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:33.450354 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3677-e685-4cca-8f8a-761692661eba None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:33.458395 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 150/300] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:33.558919 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3677-e685-4cca-8f8a-761692661eba None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:33.582366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:33.593394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa1244-8394-46d5-9efe-c627892fba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:33.594029 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa1244-8394-46d5-9efe-c627892fba66 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:33.594307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa1244-8394-46d5-9efe-c627892fba66 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:33.594622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa1244-8394-46d5-9efe-c627892fba66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:33.605051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa1244-8394-46d5-9efe-c627892fba66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-f1fa1244-8394-46d5-9efe-c627892fba66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:33.610629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:33.611568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:33.612369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 151/301] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:33.617765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b4838-d3b7-4cd3-a33d-17c9588d49cc None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:33.719106 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b4838-d3b7-4cd3-a33d-17c9588d49cc None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:33.730746 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa1244-8394-46d5-9efe-c627892fba66 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:33.764348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ffd2a-7922-4892-89e9-455fdfacb351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:33.765756 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ffd2a-7922-4892-89e9-455fdfacb351 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:33.766224 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ffd2a-7922-4892-89e9-455fdfacb351 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:33.766507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ffd2a-7922-4892-89e9-455fdfacb351 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:33.767217 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ffd2a-7922-4892-89e9-455fdfacb351 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:33.767527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ffd2a-7922-4892-89e9-455fdfacb351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:33.768892 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ffd2a-7922-4892-89e9-455fdfacb351 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:33.777273 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 151/302] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:33.777911 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ffd2a-7922-4892-89e9-455fdfacb351 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:33.803224 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:33.841263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa1244-8394-46d5-9efe-c627892fba66 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:33.876371 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052be887-eac4-4511-b817-51d956da4e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:33.876931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052be887-eac4-4511-b817-51d956da4e98 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:33.877218 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052be887-eac4-4511-b817-51d956da4e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:33.877480 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052be887-eac4-4511-b817-51d956da4e98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:33.887389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052be887-eac4-4511-b817-51d956da4e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:33.888352 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ffd2a-7922-4892-89e9-455fdfacb351 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-052be887-eac4-4511-b817-51d956da4e98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:33.892475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:33.893517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 152/303] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:38:33.899215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052be887-eac4-4511-b817-51d956da4e98 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:33.932109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af05c8-4543-424d-94a0-d94a189d8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:33.932987 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af05c8-4543-424d-94a0-d94a189d8b9a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:33.933418 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af05c8-4543-424d-94a0-d94a189d8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:33.933840 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af05c8-4543-424d-94a0-d94a189d8b9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:33.935145 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af05c8-4543-424d-94a0-d94a189d8b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:33.937644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af05c8-4543-424d-94a0-d94a189d8b9a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:33.939534 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 152/304] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:33.940431 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af05c8-4543-424d-94a0-d94a189d8b9a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:33.947147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:34.005197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052be887-eac4-4511-b817-51d956da4e98 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:34.037399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:34.041504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e17768-49c8-4913-b04b-71925ba2670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:34.042122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e17768-49c8-4913-b04b-71925ba2670c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:34.042405 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e17768-49c8-4913-b04b-71925ba2670c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:34.042687 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e17768-49c8-4913-b04b-71925ba2670c None admin] PATH_INFO: `/v3/users/7b137232b997473fa89eee73c6d24b22` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:34.050491 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af05c8-4543-424d-94a0-d94a189d8b9a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:34.058432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e17768-49c8-4913-b04b-71925ba2670c None admin] RBAC: Authorizing `identity:get_user(user_id=7b137232b997473fa89eee73c6d24b22)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:34.060298 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e17768-49c8-4913-b04b-71925ba2670c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:34.067605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 153/305] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:33 2022] GET /identity/v3/users/7b137232b997473fa89eee73c6d24b22 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:34.067605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e17768-49c8-4913-b04b-71925ba2670c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:34.089281 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c666-30b8-4abd-858b-55bc0b9fae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:34.090044 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c666-30b8-4abd-858b-55bc0b9fae8a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:34.090349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c666-30b8-4abd-858b-55bc0b9fae8a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:34.090979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c666-30b8-4abd-858b-55bc0b9fae8a None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:34.094428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c666-30b8-4abd-858b-55bc0b9fae8a None admin] RBAC: Adding query filter params (name=member) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:34.094428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c666-30b8-4abd-858b-55bc0b9fae8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:34.094428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c666-30b8-4abd-858b-55bc0b9fae8a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:34.105039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 153/306] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:34.105662 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c666-30b8-4abd-858b-55bc0b9fae8a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:34.175841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e17768-49c8-4913-b04b-71925ba2670c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:34.177274 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:34.215116 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c666-30b8-4abd-858b-55bc0b9fae8a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:34.219212 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7ac5b-6afc-44b3-a745-94215f13058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:34.219846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7ac5b-6afc-44b3-a745-94215f13058d None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:34.220120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7ac5b-6afc-44b3-a745-94215f13058d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:34.220384 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7ac5b-6afc-44b3-a745-94215f13058d None admin] PATH_INFO: `/v3/groups` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:34.221018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7ac5b-6afc-44b3-a745-94215f13058d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:34.222456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7ac5b-6afc-44b3-a745-94215f13058d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:34.239166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 154/307] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Oct 3 14:38:34 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:34.240035 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7ac5b-6afc-44b3-a745-94215f13058d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:34.265597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc1e62-bbbb-4332-93c2-f9b7999facdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:34.266587 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc1e62-bbbb-4332-93c2-f9b7999facdc None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:34.266873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc1e62-bbbb-4332-93c2-f9b7999facdc None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:34.267215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc1e62-bbbb-4332-93c2-f9b7999facdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:34.267942 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc1e62-bbbb-4332-93c2-f9b7999facdc None admin] RBAC: Adding query filter params (role.id=6cbe97afa726447d8f6888e2faddeea4, user.id=7b137232b997473fa89eee73c6d24b22, scope.system=all) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:34.268258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc1e62-bbbb-4332-93c2-f9b7999facdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:34.269890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc1e62-bbbb-4332-93c2-f9b7999facdc None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:34.276024 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 154/308] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Oct 3 14:38:34 2022] GET /identity/v3/role_assignments?user.id=7b137232b997473fa89eee73c6d24b22&scope.system=all&role.id=6cbe97afa726447d8f6888e2faddeea4 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:34.316966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979351-d40f-47ce-94b8-6e8211d92f22 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:34.317253 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979351-d40f-47ce-94b8-6e8211d92f22 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:34.317536 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979351-d40f-47ce-94b8-6e8211d92f22 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:34.319111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 155/309] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:34.325591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cc81-c91c-41a9-b3a9-1991565ab4ab None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:34.326219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cc81-c91c-41a9-b3a9-1991565ab4ab None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:34.326718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cc81-c91c-41a9-b3a9-1991565ab4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:34.348333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-8778cc81-c91c-41a9-b3a9-1991565ab4ab None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:34.350193 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-8778cc81-c91c-41a9-b3a9-1991565ab4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:34.363346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:34.383682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7ac5b-6afc-44b3-a745-94215f13058d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:34.437547 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837d179-21f5-4955-b156-aea12768d600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:34.438816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837d179-21f5-4955-b156-aea12768d600 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:34.439435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837d179-21f5-4955-b156-aea12768d600 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:34.439908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837d179-21f5-4955-b156-aea12768d600 None admin] PATH_INFO: `/v3/users/279f4b16677540f09558589930596cee` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:34.441362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837d179-21f5-4955-b156-aea12768d600 None admin] RBAC: Authorizing `identity:get_user(user_id=279f4b16677540f09558589930596cee)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:34.443128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837d179-21f5-4955-b156-aea12768d600 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:34.445493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 155/310] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:34 2022] GET /identity/v3/users/279f4b16677540f09558589930596cee => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:34.447103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 156/311] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:34.450826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837d179-21f5-4955-b156-aea12768d600 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:34.486833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:34.557379 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837d179-21f5-4955-b156-aea12768d600 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:34.591486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892561d2-cba2-41f8-a41c-dd5032d9dec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:34.592135 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892561d2-cba2-41f8-a41c-dd5032d9dec5 None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:34.592413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892561d2-cba2-41f8-a41c-dd5032d9dec5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:34.593199 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892561d2-cba2-41f8-a41c-dd5032d9dec5 None admin] PATH_INFO: `/v3/system/users/279f4b16677540f09558589930596cee/roles/5039147f7bed444380ba0a7d7b6c2269` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:34.594590 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892561d2-cba2-41f8-a41c-dd5032d9dec5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=279f4b16677540f09558589930596cee, role_id=5039147f7bed444380ba0a7d7b6c2269)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:34.595977 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892561d2-cba2-41f8-a41c-dd5032d9dec5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:34.606928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 156/312] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Oct 3 14:38:34 2022] PUT /identity/v3/system/users/279f4b16677540f09558589930596cee/roles/5039147f7bed444380ba0a7d7b6c2269 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:34.721721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778cc81-c91c-41a9-b3a9-1991565ab4ab None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:34.831573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778cc81-c91c-41a9-b3a9-1991565ab4ab None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:34.867187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bbb9e-c30e-4394-a73c-fc5fb23f0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:34.867821 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbb9e-c30e-4394-a73c-fc5fb23f0f41 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:34.868097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbb9e-c30e-4394-a73c-fc5fb23f0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:34.868417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbb9e-c30e-4394-a73c-fc5fb23f0f41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:34.879848 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bbb9e-c30e-4394-a73c-fc5fb23f0f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-2d6bbb9e-c30e-4394-a73c-fc5fb23f0f41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:34.884701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:34.885588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:34.886369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 157/313] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:34.894433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892561d2-cba2-41f8-a41c-dd5032d9dec5 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:34.999405 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:35.006056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892561d2-cba2-41f8-a41c-dd5032d9dec5 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:35.044800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3d442-ad71-4918-99f9-beb1ffa922e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:35.045416 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3d442-ad71-4918-99f9-beb1ffa922e4 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:35.045694 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3d442-ad71-4918-99f9-beb1ffa922e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:35.046514 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3d442-ad71-4918-99f9-beb1ffa922e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:35.047288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3d442-ad71-4918-99f9-beb1ffa922e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:35.047607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3d442-ad71-4918-99f9-beb1ffa922e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:35.049018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3d442-ad71-4918-99f9-beb1ffa922e4 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:35.058431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 157/314] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:35.065166 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bbb9e-c30e-4394-a73c-fc5fb23f0f41 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:35.069911 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:35.178649 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bbb9e-c30e-4394-a73c-fc5fb23f0f41 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:35.215422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773eee2-e0dd-4c66-847a-d1589322351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:35.216801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773eee2-e0dd-4c66-847a-d1589322351f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:35.217283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773eee2-e0dd-4c66-847a-d1589322351f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:35.217821 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773eee2-e0dd-4c66-847a-d1589322351f None admin] PATH_INFO: `/v3/users/cabebc80479943279734c642353d579c` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:35.219428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773eee2-e0dd-4c66-847a-d1589322351f None admin] RBAC: Authorizing `identity:get_user(user_id=cabebc80479943279734c642353d579c)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:35.221096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773eee2-e0dd-4c66-847a-d1589322351f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:35.222982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 158/315] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:35 2022] GET /identity/v3/users/cabebc80479943279734c642353d579c => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:35.228719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3d442-ad71-4918-99f9-beb1ffa922e4 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:35.349135 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3d442-ad71-4918-99f9-beb1ffa922e4 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:35.384506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b34deb-cf31-46f4-b172-345455d18bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:35.385137 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b34deb-cf31-46f4-b172-345455d18bfc None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:35.385372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b34deb-cf31-46f4-b172-345455d18bfc None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:35.385644 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b34deb-cf31-46f4-b172-345455d18bfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:35.411149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:35.454973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b34deb-cf31-46f4-b172-345455d18bfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:35.456404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b34deb-cf31-46f4-b172-345455d18bfc None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:35.560282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 158/316] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:35.566163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773eee2-e0dd-4c66-847a-d1589322351f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:35.641507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:35.674428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773eee2-e0dd-4c66-847a-d1589322351f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:35.709598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0c6e9-cca8-4fba-969c-4cba9293f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:35.710581 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0c6e9-cca8-4fba-969c-4cba9293f811 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:35.711154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0c6e9-cca8-4fba-969c-4cba9293f811 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:35.711648 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0c6e9-cca8-4fba-969c-4cba9293f811 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:35.713066 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0c6e9-cca8-4fba-969c-4cba9293f811 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:35.714691 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0c6e9-cca8-4fba-969c-4cba9293f811 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:35.716849 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 159/317] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:35 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:35.723263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b34deb-cf31-46f4-b172-345455d18bfc None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:35.782417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:35.832086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b34deb-cf31-46f4-b172-345455d18bfc None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:35.867156 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e5a3-7faa-4e87-baf8-bf4f1eb8058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:35.867769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e5a3-7faa-4e87-baf8-bf4f1eb8058f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:35.868055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e5a3-7faa-4e87-baf8-bf4f1eb8058f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:35.868332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e5a3-7faa-4e87-baf8-bf4f1eb8058f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:35.869051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e5a3-7faa-4e87-baf8-bf4f1eb8058f None admin] RBAC: Adding query filter params (role.id=6cbe97afa726447d8f6888e2faddeea4, scope.project.id=b33daf122f6643588023e9a918ba418b, user.id=cabebc80479943279734c642353d579c) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:35.869363 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e5a3-7faa-4e87-baf8-bf4f1eb8058f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:35.871078 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e5a3-7faa-4e87-baf8-bf4f1eb8058f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:35.877192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 159/318] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:38:35 2022] GET /identity/v3/role_assignments?user.id=cabebc80479943279734c642353d579c&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=6cbe97afa726447d8f6888e2faddeea4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:36.545140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c754-5719-4b24-93f3-45a511372086 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:36.545639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c754-5719-4b24-93f3-45a511372086 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:36.545639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c754-5719-4b24-93f3-45a511372086 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:36.547991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 160/319] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:36.553686 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce648c-84f4-4b95-b5b8-ba6043e71408 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:36.554190 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce648c-84f4-4b95-b5b8-ba6043e71408 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:36.554263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce648c-84f4-4b95-b5b8-ba6043e71408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:36.573968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-b3ce648c-84f4-4b95-b5b8-ba6043e71408 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:36.575212 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-b3ce648c-84f4-4b95-b5b8-ba6043e71408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:36.640560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 160/320] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:36.664034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdd785-8e3f-486f-9045-b5e29ebc2c34 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:36.664318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdd785-8e3f-486f-9045-b5e29ebc2c34 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:36.664605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdd785-8e3f-486f-9045-b5e29ebc2c34 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:36.666097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 161/321] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:36.671521 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27cf4c-2243-41ce-8207-0f52d72fbabc None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:36.671972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27cf4c-2243-41ce-8207-0f52d72fbabc None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:36.672248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27cf4c-2243-41ce-8207-0f52d72fbabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:36.691086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-aa27cf4c-2243-41ce-8207-0f52d72fbabc None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:36.692264 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-aa27cf4c-2243-41ce-8207-0f52d72fbabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:36.744239 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:36.768614 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 161/322] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:36.836689 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d8c9b-e03f-4371-a932-1ed83b584d17 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:36.836990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d8c9b-e03f-4371-a932-1ed83b584d17 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:36.837243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d8c9b-e03f-4371-a932-1ed83b584d17 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:36.838702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 162/323] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:36.844572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61341b9f-4a9b-4415-bc2e-d1741615fcc8 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:36.844855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61341b9f-4a9b-4415-bc2e-d1741615fcc8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:36.845126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61341b9f-4a9b-4415-bc2e-d1741615fcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:36.863198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-61341b9f-4a9b-4415-bc2e-d1741615fcc8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:36.864359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-61341b9f-4a9b-4415-bc2e-d1741615fcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:36.907477 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d8c9b-e03f-4371-a932-1ed83b584d17 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:36.933731 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 162/324] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:37.010842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d8c9b-e03f-4371-a932-1ed83b584d17 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.035965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61341b9f-4a9b-4415-bc2e-d1741615fcc8 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:37.045083 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b3a4d-6876-4271-9a6a-4c34e5e7cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.045943 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3a4d-6876-4271-9a6a-4c34e5e7cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.046862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3a4d-6876-4271-9a6a-4c34e5e7cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.047158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3a4d-6876-4271-9a6a-4c34e5e7cfd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.048302 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b3a4d-6876-4271-9a6a-4c34e5e7cfd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:37.049772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b3a4d-6876-4271-9a6a-4c34e5e7cfd0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:37.051575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 163/325] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:37.056930 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b3a4d-6876-4271-9a6a-4c34e5e7cfd0 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:37.068154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:37.156742 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61341b9f-4a9b-4415-bc2e-d1741615fcc8 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.166082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b3a4d-6876-4271-9a6a-4c34e5e7cfd0 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.168013 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:37.196209 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7c53f-9945-4791-a61d-4703b7211f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.197027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c53f-9945-4791-a61d-4703b7211f3d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.197161 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c53f-9945-4791-a61d-4703b7211f3d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.197375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c53f-9945-4791-a61d-4703b7211f3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.201950 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ad856-76a1-4af3-be31-a1fa13ddfa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.202577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ad856-76a1-4af3-be31-a1fa13ddfa10 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.202852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ad856-76a1-4af3-be31-a1fa13ddfa10 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.203152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ad856-76a1-4af3-be31-a1fa13ddfa10 None admin] PATH_INFO: `/v3/groups` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.203772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ad856-76a1-4af3-be31-a1fa13ddfa10 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:37.205194 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ad856-76a1-4af3-be31-a1fa13ddfa10 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:37.208233 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7c53f-9945-4791-a61d-4703b7211f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-aef7c53f-9945-4791-a61d-4703b7211f3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:37.213265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:37.214157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:37.215015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 163/326] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:37.215672 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7c53f-9945-4791-a61d-4703b7211f3d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:37.222375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 164/327] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Oct 3 14:38:37 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:37.223286 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ad856-76a1-4af3-be31-a1fa13ddfa10 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:37.300967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:37.334711 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7c53f-9945-4791-a61d-4703b7211f3d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.340646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ad856-76a1-4af3-be31-a1fa13ddfa10 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.375716 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ef8bd-01df-4c17-a6a7-823ee75d9ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.376362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ef8bd-01df-4c17-a6a7-823ee75d9ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.376757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ef8bd-01df-4c17-a6a7-823ee75d9ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.377138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ef8bd-01df-4c17-a6a7-823ee75d9ec2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.379450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ec1f5-5929-441e-9c6f-b46ea06c601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.380079 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ec1f5-5929-441e-9c6f-b46ea06c601c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.380363 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ec1f5-5929-441e-9c6f-b46ea06c601c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.380640 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ec1f5-5929-441e-9c6f-b46ea06c601c None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.381318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ec1f5-5929-441e-9c6f-b46ea06c601c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:37.381623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ec1f5-5929-441e-9c6f-b46ea06c601c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:37.383032 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ec1f5-5929-441e-9c6f-b46ea06c601c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:37.389927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ef8bd-01df-4c17-a6a7-823ee75d9ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:37.392429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 165/328] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-3f4ef8bd-01df-4c17-a6a7-823ee75d9ec2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:37.395165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:37.396041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:37.396848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 164/329] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:37.398504 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ec1f5-5929-441e-9c6f-b46ea06c601c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:37.401707 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ef8bd-01df-4c17-a6a7-823ee75d9ec2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:37.438751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:37.512902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ec1f5-5929-441e-9c6f-b46ea06c601c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.538834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ef8bd-01df-4c17-a6a7-823ee75d9ec2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.547721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:37.555960 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccce4c3-c580-461f-87ab-a6785abbf80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.555960 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccce4c3-c580-461f-87ab-a6785abbf80d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.556210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccce4c3-c580-461f-87ab-a6785abbf80d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.556434 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccce4c3-c580-461f-87ab-a6785abbf80d None admin] PATH_INFO: `/v3/users/7b137232b997473fa89eee73c6d24b22` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.557609 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccce4c3-c580-461f-87ab-a6785abbf80d None admin] RBAC: Authorizing `identity:get_user(user_id=7b137232b997473fa89eee73c6d24b22)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:37.559079 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccce4c3-c580-461f-87ab-a6785abbf80d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:37.563289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 166/330] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:37 2022] GET /identity/v3/users/7b137232b997473fa89eee73c6d24b22 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:37.566384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccce4c3-c580-461f-87ab-a6785abbf80d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:37.596277 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff3f9-21bd-465a-b271-9aa0b095a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.596841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff3f9-21bd-465a-b271-9aa0b095a808 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.597098 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff3f9-21bd-465a-b271-9aa0b095a808 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.597378 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff3f9-21bd-465a-b271-9aa0b095a808 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.598047 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ff3f9-21bd-465a-b271-9aa0b095a808 None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:37.598354 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ff3f9-21bd-465a-b271-9aa0b095a808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:37.599763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ff3f9-21bd-465a-b271-9aa0b095a808 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:37.609910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 165/331] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:37.615575 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff3f9-21bd-465a-b271-9aa0b095a808 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:37.703914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccce4c3-c580-461f-87ab-a6785abbf80d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.734308 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:37.743249 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a76b0-8be0-4ba1-b18d-a29a737f4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.743941 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a76b0-8be0-4ba1-b18d-a29a737f4088 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.744229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a76b0-8be0-4ba1-b18d-a29a737f4088 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.744512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a76b0-8be0-4ba1-b18d-a29a737f4088 None admin] PATH_INFO: `/v3/system/users/7b137232b997473fa89eee73c6d24b22/roles/6cbe97afa726447d8f6888e2faddeea4` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.746271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a76b0-8be0-4ba1-b18d-a29a737f4088 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7b137232b997473fa89eee73c6d24b22, role_id=6cbe97afa726447d8f6888e2faddeea4)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:37.746749 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff3f9-21bd-465a-b271-9aa0b095a808 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.747684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a76b0-8be0-4ba1-b18d-a29a737f4088 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:37.761458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 167/332] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Oct 3 14:38:37 2022] PUT /identity/v3/system/users/7b137232b997473fa89eee73c6d24b22/roles/6cbe97afa726447d8f6888e2faddeea4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 14:38:37.797151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd38b44-acd8-46f5-b5a3-79af7862c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.797867 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd38b44-acd8-46f5-b5a3-79af7862c3ef None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.798151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd38b44-acd8-46f5-b5a3-79af7862c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.798422 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd38b44-acd8-46f5-b5a3-79af7862c3ef None admin] PATH_INFO: `/v3/users/279f4b16677540f09558589930596cee` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.799632 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd38b44-acd8-46f5-b5a3-79af7862c3ef None admin] RBAC: Authorizing `identity:get_user(user_id=279f4b16677540f09558589930596cee)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:37.801065 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd38b44-acd8-46f5-b5a3-79af7862c3ef None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:37.802879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 166/333] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:37 2022] GET /identity/v3/users/279f4b16677540f09558589930596cee => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:37.808897 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a76b0-8be0-4ba1-b18d-a29a737f4088 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:37.884232 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:37.939467 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a76b0-8be0-4ba1-b18d-a29a737f4088 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:37.983945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ca47d-0c27-4a84-bda0-92952ce5a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:37.984800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ca47d-0c27-4a84-bda0-92952ce5a259 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:37.985118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ca47d-0c27-4a84-bda0-92952ce5a259 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:37.985395 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ca47d-0c27-4a84-bda0-92952ce5a259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:37.986141 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ca47d-0c27-4a84-bda0-92952ce5a259 None admin] RBAC: Adding query filter params (role.id=5039147f7bed444380ba0a7d7b6c2269, user.id=279f4b16677540f09558589930596cee, scope.system=all) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:37.986452 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ca47d-0c27-4a84-bda0-92952ce5a259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:37.987939 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ca47d-0c27-4a84-bda0-92952ce5a259 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:38.001147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 168/334] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Oct 3 14:38:37 2022] GET /identity/v3/role_assignments?user.id=279f4b16677540f09558589930596cee&scope.system=all&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:40.148620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce0486-9e87-4df7-ab94-58a14eacae52 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:40.149126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce0486-9e87-4df7-ab94-58a14eacae52 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:40.149201 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce0486-9e87-4df7-ab94-58a14eacae52 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:40.150774 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 167/335] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:40.156170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2063-7253-426d-b2d7-30c74cf6277c None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:40.156636 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2063-7253-426d-b2d7-30c74cf6277c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:40.156714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2063-7253-426d-b2d7-30c74cf6277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:40.184293 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-4bfc2063-7253-426d-b2d7-30c74cf6277c None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:40.185479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-4bfc2063-7253-426d-b2d7-30c74cf6277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:40.265076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 169/336] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:40.358782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7ebe-5804-4d0f-be1a-83d7cb41782a None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:40.359496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7ebe-5804-4d0f-be1a-83d7cb41782a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:40.359980 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7ebe-5804-4d0f-be1a-83d7cb41782a None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:40.361804 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 168/337] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:40.367058 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb07d83-dd1d-4ead-94ee-b488bafcf392 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:40.367349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb07d83-dd1d-4ead-94ee-b488bafcf392 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:40.367623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb07d83-dd1d-4ead-94ee-b488bafcf392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:40.384656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde4ec2-d307-4fff-b110-2d3c21cbeb4a None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:40.384973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde4ec2-d307-4fff-b110-2d3c21cbeb4a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:40.385229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde4ec2-d307-4fff-b110-2d3c21cbeb4a None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:40.386687 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 169/338] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:40.392599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff46c3-3073-4fa2-8730-4290ebc6a2c4 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:40.393141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff46c3-3073-4fa2-8730-4290ebc6a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:40.393610 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff46c3-3073-4fa2-8730-4290ebc6a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:40.395934 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-0cb07d83-dd1d-4ead-94ee-b488bafcf392 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:40.397123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-0cb07d83-dd1d-4ead-94ee-b488bafcf392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:40.423999 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-73ff46c3-3073-4fa2-8730-4290ebc6a2c4 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:40.425644 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-73ff46c3-3073-4fa2-8730-4290ebc6a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:40.470749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:40.508819 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 170/339] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:40.533249 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 170/340] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:40.651956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b60763-8600-4876-99aa-7c6e246bbc04 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:40.652245 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b60763-8600-4876-99aa-7c6e246bbc04 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:40.652417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b60763-8600-4876-99aa-7c6e246bbc04 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:40.653768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 171/341] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:40.659745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feea29d-4383-4c4f-b9f4-3e13009ed9ca None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:40.660028 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feea29d-4383-4c4f-b9f4-3e13009ed9ca None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:40.660302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feea29d-4383-4c4f-b9f4-3e13009ed9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:40.687972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-4feea29d-4383-4c4f-b9f4-3e13009ed9ca None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:40.689207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-4feea29d-4383-4c4f-b9f4-3e13009ed9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:40.699394 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b60763-8600-4876-99aa-7c6e246bbc04 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:40.782206 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 171/342] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:40.883782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b60763-8600-4876-99aa-7c6e246bbc04 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:40.926291 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0888882-984d-4a9a-a630-bcac34b310fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:40.927299 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0888882-984d-4a9a-a630-bcac34b310fd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:40.927787 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0888882-984d-4a9a-a630-bcac34b310fd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:40.928283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0888882-984d-4a9a-a630-bcac34b310fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:40.946110 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0888882-984d-4a9a-a630-bcac34b310fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:40.949773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feea29d-4383-4c4f-b9f4-3e13009ed9ca None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-a0888882-984d-4a9a-a630-bcac34b310fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:40.951744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:40.953627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:40.954438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:40.957519 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 172/343] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:38:40.965899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0888882-984d-4a9a-a630-bcac34b310fd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:40.995641 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:41.032279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:41.109501 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0888882-984d-4a9a-a630-bcac34b310fd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:41.159858 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feea29d-4383-4c4f-b9f4-3e13009ed9ca None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:41.176587 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68daf01-e7d4-45d1-a69d-7a625e97720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:41.177147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68daf01-e7d4-45d1-a69d-7a625e97720c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:41.177408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68daf01-e7d4-45d1-a69d-7a625e97720c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:41.177682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68daf01-e7d4-45d1-a69d-7a625e97720c None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:41.178348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68daf01-e7d4-45d1-a69d-7a625e97720c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:41.178651 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68daf01-e7d4-45d1-a69d-7a625e97720c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:41.180057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68daf01-e7d4-45d1-a69d-7a625e97720c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:41.191722 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 173/344] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:41.194771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68daf01-e7d4-45d1-a69d-7a625e97720c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:41.224865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712fbac-4cbd-42fc-b5c6-15821eb54e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:41.225893 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712fbac-4cbd-42fc-b5c6-15821eb54e1c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:41.226452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712fbac-4cbd-42fc-b5c6-15821eb54e1c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:41.227068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712fbac-4cbd-42fc-b5c6-15821eb54e1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:41.246812 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712fbac-4cbd-42fc-b5c6-15821eb54e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-6712fbac-4cbd-42fc-b5c6-15821eb54e1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:41.253280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:41.254169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:41.255019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:41.257635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 172/345] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:41.258643 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712fbac-4cbd-42fc-b5c6-15821eb54e1c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:41.318988 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68daf01-e7d4-45d1-a69d-7a625e97720c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:41.320528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:41.357946 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592001ce-a56c-46fb-a763-091d7fba4a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:41.359602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592001ce-a56c-46fb-a763-091d7fba4a76 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:41.360192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592001ce-a56c-46fb-a763-091d7fba4a76 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:41.360667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592001ce-a56c-46fb-a763-091d7fba4a76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:41.364607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:41.376181 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592001ce-a56c-46fb-a763-091d7fba4a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-592001ce-a56c-46fb-a763-091d7fba4a76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:41.381759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:41.382643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:41.383524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:41.385981 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 174/346] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:41.386992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592001ce-a56c-46fb-a763-091d7fba4a76 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:41.388195 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712fbac-4cbd-42fc-b5c6-15821eb54e1c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:41.440236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230b297-3bae-455f-893a-006cabf7d6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:41.440774 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b297-3bae-455f-893a-006cabf7d6da None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:41.441053 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b297-3bae-455f-893a-006cabf7d6da None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:41.441324 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b297-3bae-455f-893a-006cabf7d6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:41.517674 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592001ce-a56c-46fb-a763-091d7fba4a76 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:41.532752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230b297-3bae-455f-893a-006cabf7d6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:41.534814 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230b297-3bae-455f-893a-006cabf7d6da None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:41.558894 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e77d8f-a971-4754-9ee7-04305ba31efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:41.559965 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e77d8f-a971-4754-9ee7-04305ba31efe None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:41.560454 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e77d8f-a971-4754-9ee7-04305ba31efe None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:41.560917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e77d8f-a971-4754-9ee7-04305ba31efe None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:41.562447 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e77d8f-a971-4754-9ee7-04305ba31efe None admin] RBAC: Adding query filter params (name=member) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:41.562978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e77d8f-a971-4754-9ee7-04305ba31efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:41.564856 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e77d8f-a971-4754-9ee7-04305ba31efe None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:41.575169 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 175/347] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:41.576269 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e77d8f-a971-4754-9ee7-04305ba31efe None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:41.608662 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:41.640333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:41.667638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 173/348] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:41.667966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230b297-3bae-455f-893a-006cabf7d6da None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:41.705132 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e77d8f-a971-4754-9ee7-04305ba31efe None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:41.750344 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb096c89-bd57-4e5c-9d70-410b36066bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:41.751386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb096c89-bd57-4e5c-9d70-410b36066bf0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:41.751881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb096c89-bd57-4e5c-9d70-410b36066bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:41.752347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb096c89-bd57-4e5c-9d70-410b36066bf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:41.765740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb096c89-bd57-4e5c-9d70-410b36066bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-cb096c89-bd57-4e5c-9d70-410b36066bf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:41.772031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:41.772927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 14:38:41.773711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:41.777087 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 176/349] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:41.778095 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb096c89-bd57-4e5c-9d70-410b36066bf0 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:41.799096 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230b297-3bae-455f-893a-006cabf7d6da None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:41.842662 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61619254-80f7-44e5-bf66-cf9b4022b9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:41.843328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61619254-80f7-44e5-bf66-cf9b4022b9a8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:41.843608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61619254-80f7-44e5-bf66-cf9b4022b9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:41.843883 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61619254-80f7-44e5-bf66-cf9b4022b9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:41.844545 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61619254-80f7-44e5-bf66-cf9b4022b9a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:41.845271 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61619254-80f7-44e5-bf66-cf9b4022b9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:41.846982 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61619254-80f7-44e5-bf66-cf9b4022b9a8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:41.858689 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 174/350] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:41.859660 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61619254-80f7-44e5-bf66-cf9b4022b9a8 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:41.886194 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:41.907661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb096c89-bd57-4e5c-9d70-410b36066bf0 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:41.917382 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:41.951515 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b221-606c-42dd-9527-302e54f2adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:41.953027 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b221-606c-42dd-9527-302e54f2adbf None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:41.953533 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b221-606c-42dd-9527-302e54f2adbf None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:41.954082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b221-606c-42dd-9527-302e54f2adbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:41.992512 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61619254-80f7-44e5-bf66-cf9b4022b9a8 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:42.037518 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5359-1467-4889-b224-1220ff138026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:42.038174 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5359-1467-4889-b224-1220ff138026 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.038455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5359-1467-4889-b224-1220ff138026 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.038731 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a5359-1467-4889-b224-1220ff138026 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.040021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a5359-1467-4889-b224-1220ff138026 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:42.041361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a5359-1467-4889-b224-1220ff138026 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:42.041470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83b221-606c-42dd-9527-302e54f2adbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:42.042910 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83b221-606c-42dd-9527-302e54f2adbf None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:42.043336 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 175/351] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:41 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:42.044104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5359-1467-4889-b224-1220ff138026 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:42.159914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:42.180971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 177/352] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:42.184815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b221-606c-42dd-9527-302e54f2adbf None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:42.196827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a5359-1467-4889-b224-1220ff138026 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:42.208984 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:42.245020 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb690-f0a6-44f1-9634-3cf1fff7fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:42.245822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb690-f0a6-44f1-9634-3cf1fff7fac2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.246101 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb690-f0a6-44f1-9634-3cf1fff7fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.246376 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb690-f0a6-44f1-9634-3cf1fff7fac2 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.247055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdb690-f0a6-44f1-9634-3cf1fff7fac2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:42.247358 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdb690-f0a6-44f1-9634-3cf1fff7fac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:42.249036 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdb690-f0a6-44f1-9634-3cf1fff7fac2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:42.260307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 176/353] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:42.261858 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56cc14-3d4d-473d-84c3-7bb3de5aad7e None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.262143 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56cc14-3d4d-473d-84c3-7bb3de5aad7e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.262414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56cc14-3d4d-473d-84c3-7bb3de5aad7e None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.263808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 177/354] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:42.264493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56cc14-3d4d-473d-84c3-7bb3de5aad7e None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:42.312540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b221-606c-42dd-9527-302e54f2adbf None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:42.356446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea04ae-5748-4023-a140-ccbfeb8b4955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:42.357193 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea04ae-5748-4023-a140-ccbfeb8b4955 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.357469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea04ae-5748-4023-a140-ccbfeb8b4955 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.357737 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea04ae-5748-4023-a140-ccbfeb8b4955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.403483 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56cc14-3d4d-473d-84c3-7bb3de5aad7e None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:42.424997 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:42.451601 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea04ae-5748-4023-a140-ccbfeb8b4955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:42.452540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8d7d4-be4b-4187-94c3-19fdea8128e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:42.452832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8d7d4-be4b-4187-94c3-19fdea8128e4 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.453117 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8d7d4-be4b-4187-94c3-19fdea8128e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.453392 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8d7d4-be4b-4187-94c3-19fdea8128e4 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.453589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea04ae-5748-4023-a140-ccbfeb8b4955 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:42.459956 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8d7d4-be4b-4187-94c3-19fdea8128e4 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:42.461393 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8d7d4-be4b-4187-94c3-19fdea8128e4 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:42.463199 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 178/355] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:42 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:42.463917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8d7d4-be4b-4187-94c3-19fdea8128e4 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:42.506865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:42.566299 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 178/356] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:42.568096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea04ae-5748-4023-a140-ccbfeb8b4955 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:42.591759 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8d7d4-be4b-4187-94c3-19fdea8128e4 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:42.632385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8653759-0b70-4c86-b858-d35c82754e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:42.633472 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653759-0b70-4c86-b858-d35c82754e5e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.633970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653759-0b70-4c86-b858-d35c82754e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.634440 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8653759-0b70-4c86-b858-d35c82754e5e None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.635903 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8653759-0b70-4c86-b858-d35c82754e5e None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:42.637321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8653759-0b70-4c86-b858-d35c82754e5e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:42.638962 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 179/357] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:42 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:42.642986 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110747f-e872-4966-9c6a-10d42e3b6b94 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.642986 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110747f-e872-4966-9c6a-10d42e3b6b94 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.642986 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110747f-e872-4966-9c6a-10d42e3b6b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.660423 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-c110747f-e872-4966-9c6a-10d42e3b6b94 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:42.661601 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-c110747f-e872-4966-9c6a-10d42e3b6b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:42.664936 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:42.686039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea04ae-5748-4023-a140-ccbfeb8b4955 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:42.722790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7d057-d276-4302-9b4c-cab4ea265872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:42.723476 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7d057-d276-4302-9b4c-cab4ea265872 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.723760 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7d057-d276-4302-9b4c-cab4ea265872 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.724033 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7d057-d276-4302-9b4c-cab4ea265872 None admin] PATH_INFO: `/v3/users/7b137232b997473fa89eee73c6d24b22` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.725171 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7d057-d276-4302-9b4c-cab4ea265872 None admin] RBAC: Authorizing `identity:get_user(user_id=7b137232b997473fa89eee73c6d24b22)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:42.726606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7d057-d276-4302-9b4c-cab4ea265872 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:42.728372 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 179/358] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:38:42 2022] GET /identity/v3/users/7b137232b997473fa89eee73c6d24b22 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:42.735323 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e87b6d-4011-4e08-86de-08391df63f60 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.735517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e87b6d-4011-4e08-86de-08391df63f60 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.735791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e87b6d-4011-4e08-86de-08391df63f60 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.737083 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 180/359] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:42.741987 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e87b6d-4011-4e08-86de-08391df63f60 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:42.745941 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 180/360] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:42.746806 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110747f-e872-4966-9c6a-10d42e3b6b94 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:42.788112 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:42.867326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e87b6d-4011-4e08-86de-08391df63f60 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:42.879699 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110747f-e872-4966-9c6a-10d42e3b6b94 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:42.913647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1320a-e90e-4f12-8555-1d1136a3dde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:42.914260 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1320a-e90e-4f12-8555-1d1136a3dde7 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.914614 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1320a-e90e-4f12-8555-1d1136a3dde7 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.914806 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1320a-e90e-4f12-8555-1d1136a3dde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.915747 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1320a-e90e-4f12-8555-1d1136a3dde7 None admin] RBAC: Adding query filter params (group.id=c19610840119412bb5fd2348f7c1c151, role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:42.916052 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1320a-e90e-4f12-8555-1d1136a3dde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:42.917588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1320a-e90e-4f12-8555-1d1136a3dde7 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:42.923296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 181/361] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:42 2022] GET /identity/v3/role_assignments?group.id=c19610840119412bb5fd2348f7c1c151&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:42.924065 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1320a-e90e-4f12-8555-1d1136a3dde7 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:42.925390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3e1ee-3ecf-4d2b-aa53-4405974bcbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:42.925959 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3e1ee-3ecf-4d2b-aa53-4405974bcbc9 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:42.925959 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3e1ee-3ecf-4d2b-aa53-4405974bcbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:42.926689 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3e1ee-3ecf-4d2b-aa53-4405974bcbc9 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:42.927866 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3e1ee-3ecf-4d2b-aa53-4405974bcbc9 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:42.929440 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3e1ee-3ecf-4d2b-aa53-4405974bcbc9 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:42.931590 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 181/362] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:42 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:42.937671 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3e1ee-3ecf-4d2b-aa53-4405974bcbc9 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:42.950929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:43.072245 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1320a-e90e-4f12-8555-1d1136a3dde7 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:43.080794 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3e1ee-3ecf-4d2b-aa53-4405974bcbc9 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:43.083071 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:43.123503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c466c8-4a9e-4c15-b597-32eebf4a0c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:43.124949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c466c8-4a9e-4c15-b597-32eebf4a0c06 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:43.125320 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c466c8-4a9e-4c15-b597-32eebf4a0c06 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:43.125603 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c466c8-4a9e-4c15-b597-32eebf4a0c06 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:43.126646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ac7c8-9628-4c4b-8a3c-8f5eaaf6f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:43.126764 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c466c8-4a9e-4c15-b597-32eebf4a0c06 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:43.127304 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ac7c8-9628-4c4b-8a3c-8f5eaaf6f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:43.127591 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ac7c8-9628-4c4b-8a3c-8f5eaaf6f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:43.127868 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ac7c8-9628-4c4b-8a3c-8f5eaaf6f1d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:43.128220 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c466c8-4a9e-4c15-b597-32eebf4a0c06 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:43.128666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ac7c8-9628-4c4b-8a3c-8f5eaaf6f1d9 None admin] RBAC: Adding query filter params (role.id=6cbe97afa726447d8f6888e2faddeea4, user.id=7b137232b997473fa89eee73c6d24b22, scope.system=all) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:43.128983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ac7c8-9628-4c4b-8a3c-8f5eaaf6f1d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:43.129810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 182/363] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:42 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:43.130527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ac7c8-9628-4c4b-8a3c-8f5eaaf6f1d9 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:43.131039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c306a8-b28d-4dc2-8f20-137a3865e2e8 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:43.131316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c306a8-b28d-4dc2-8f20-137a3865e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:43.131589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c306a8-b28d-4dc2-8f20-137a3865e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:43.146178 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 182/364] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Oct 3 14:38:42 2022] GET /identity/v3/role_assignments?user.id=7b137232b997473fa89eee73c6d24b22&scope.system=all&role.id=6cbe97afa726447d8f6888e2faddeea4 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:43.147150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ac7c8-9628-4c4b-8a3c-8f5eaaf6f1d9 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:43.158897 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a8c306a8-b28d-4dc2-8f20-137a3865e2e8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:43.160258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a8c306a8-b28d-4dc2-8f20-137a3865e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:43.278927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 183/365] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:43.279839 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c306a8-b28d-4dc2-8f20-137a3865e2e8 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:43.281887 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ac7c8-9628-4c4b-8a3c-8f5eaaf6f1d9 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:43.302878 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:43.343291 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cee70b-e114-4239-aec9-234424e1c119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:43.345281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cee70b-e114-4239-aec9-234424e1c119 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:43.345281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cee70b-e114-4239-aec9-234424e1c119 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:43.345281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cee70b-e114-4239-aec9-234424e1c119 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:43.349134 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cee70b-e114-4239-aec9-234424e1c119 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:43.351069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cee70b-e114-4239-aec9-234424e1c119 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:43.353182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 183/366] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:43 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:43.354347 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cee70b-e114-4239-aec9-234424e1c119 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:43.401107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:43.418789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c306a8-b28d-4dc2-8f20-137a3865e2e8 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:43.465902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aaf33-9715-43d5-b397-633930e88eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:43.466925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aaf33-9715-43d5-b397-633930e88eec None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:43.467678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aaf33-9715-43d5-b397-633930e88eec None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:43.468420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aaf33-9715-43d5-b397-633930e88eec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:43.485609 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128aaf33-9715-43d5-b397-633930e88eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-128aaf33-9715-43d5-b397-633930e88eec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:43.493180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:43.494076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:43.494914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:43.499361 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 184/367] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:43.499361 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aaf33-9715-43d5-b397-633930e88eec None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:43.502772 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cee70b-e114-4239-aec9-234424e1c119 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:43.547149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5d241-eb4a-4064-a4c3-ef4ae23dfe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:43.547869 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5d241-eb4a-4064-a4c3-ef4ae23dfe51 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:43.548152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5d241-eb4a-4064-a4c3-ef4ae23dfe51 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:43.548429 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5d241-eb4a-4064-a4c3-ef4ae23dfe51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:43.549163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5d241-eb4a-4064-a4c3-ef4ae23dfe51 None admin] RBAC: Adding query filter params (group.id=c19610840119412bb5fd2348f7c1c151, role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=b33daf122f6643588023e9a918ba418b) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:43.549534 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5d241-eb4a-4064-a4c3-ef4ae23dfe51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:43.551005 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5d241-eb4a-4064-a4c3-ef4ae23dfe51 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:43.557657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 184/368] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:43 2022] GET /identity/v3/role_assignments?group.id=c19610840119412bb5fd2348f7c1c151&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:43.558480 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5d241-eb4a-4064-a4c3-ef4ae23dfe51 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:43.646036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:43.719922 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aaf33-9715-43d5-b397-633930e88eec None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:43.722068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:43.734393 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5d241-eb4a-4064-a4c3-ef4ae23dfe51 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:43.779096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590c28-cbd7-42c9-a9ac-60f61a1cf887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:43.779725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590c28-cbd7-42c9-a9ac-60f61a1cf887 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:43.780644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590c28-cbd7-42c9-a9ac-60f61a1cf887 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:43.780984 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590c28-cbd7-42c9-a9ac-60f61a1cf887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:43.781735 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f590c28-cbd7-42c9-a9ac-60f61a1cf887 None admin] RBAC: Adding query filter params (group.id=c19610840119412bb5fd2348f7c1c151, role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:43.781996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1c718-43a4-4f61-b5fd-be3e6aa3a4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:43.782112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f590c28-cbd7-42c9-a9ac-60f61a1cf887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:43.782624 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1c718-43a4-4f61-b5fd-be3e6aa3a4a3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:43.782906 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1c718-43a4-4f61-b5fd-be3e6aa3a4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:43.783533 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f590c28-cbd7-42c9-a9ac-60f61a1cf887 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:43.784093 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1c718-43a4-4f61-b5fd-be3e6aa3a4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:43.784771 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1c718-43a4-4f61-b5fd-be3e6aa3a4a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:43.785075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1c718-43a4-4f61-b5fd-be3e6aa3a4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:43.786428 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1c718-43a4-4f61-b5fd-be3e6aa3a4a3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:43.792182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 185/369] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:43 2022] GET /identity/v3/role_assignments?group.id=c19610840119412bb5fd2348f7c1c151&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:43.793029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590c28-cbd7-42c9-a9ac-60f61a1cf887 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:43.801231 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 185/370] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:43.807299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1c718-43a4-4f61-b5fd-be3e6aa3a4a3 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:43.968816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590c28-cbd7-42c9-a9ac-60f61a1cf887 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:44.013354 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1c718-43a4-4f61-b5fd-be3e6aa3a4a3 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:44.037741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0566d5-5a1f-4e9c-a9b8-72da67fa4f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:44.038507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0566d5-5a1f-4e9c-a9b8-72da67fa4f41 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:44.038793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0566d5-5a1f-4e9c-a9b8-72da67fa4f41 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:44.039441 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0566d5-5a1f-4e9c-a9b8-72da67fa4f41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:44.048586 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:44.054974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0566d5-5a1f-4e9c-a9b8-72da67fa4f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-fe0566d5-5a1f-4e9c-a9b8-72da67fa4f41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:44.060565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:44.061836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:44.063007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 186/371] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:44.070140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0566d5-5a1f-4e9c-a9b8-72da67fa4f41 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:44.098330 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98657de9-2cbc-4460-a686-5b30c5ad7d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:44.099394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98657de9-2cbc-4460-a686-5b30c5ad7d00 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:44.099831 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98657de9-2cbc-4460-a686-5b30c5ad7d00 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:44.100330 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98657de9-2cbc-4460-a686-5b30c5ad7d00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:44.153841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:44.203446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0566d5-5a1f-4e9c-a9b8-72da67fa4f41 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:44.235493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98657de9-2cbc-4460-a686-5b30c5ad7d00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:44.236884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98657de9-2cbc-4460-a686-5b30c5ad7d00 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:44.262090 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d747430-455d-4833-964d-eadd94f73fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:44.262767 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d747430-455d-4833-964d-eadd94f73fb8 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:44.263092 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d747430-455d-4833-964d-eadd94f73fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:44.263373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d747430-455d-4833-964d-eadd94f73fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:44.264041 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d747430-455d-4833-964d-eadd94f73fb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:44.264977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d747430-455d-4833-964d-eadd94f73fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:44.266701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d747430-455d-4833-964d-eadd94f73fb8 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:44.285392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 187/372] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:44.292207 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d747430-455d-4833-964d-eadd94f73fb8 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:44.402199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:44.433331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 186/373] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:44.441319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98657de9-2cbc-4460-a686-5b30c5ad7d00 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:44.478389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d747430-455d-4833-964d-eadd94f73fb8 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:44.513595 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:44.518120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6696c-cf75-4a21-af94-a56efab1950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:44.518741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6696c-cf75-4a21-af94-a56efab1950c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:44.519051 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6696c-cf75-4a21-af94-a56efab1950c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:44.519325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6696c-cf75-4a21-af94-a56efab1950c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:44.568989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98657de9-2cbc-4460-a686-5b30c5ad7d00 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:44.610989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c9179-2632-4d5d-83a5-4ea9cda7c2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:44.611213 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6696c-cf75-4a21-af94-a56efab1950c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:44.611646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c9179-2632-4d5d-83a5-4ea9cda7c2b9 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:44.611921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c9179-2632-4d5d-83a5-4ea9cda7c2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:44.612192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c9179-2632-4d5d-83a5-4ea9cda7c2b9 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:44.612565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6696c-cf75-4a21-af94-a56efab1950c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:44.613364 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c9179-2632-4d5d-83a5-4ea9cda7c2b9 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:44.615118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c9179-2632-4d5d-83a5-4ea9cda7c2b9 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:44.618038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 187/374] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:44 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:44.624026 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c9179-2632-4d5d-83a5-4ea9cda7c2b9 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:44.684289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:44.754638 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 188/375] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:44.767034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6696c-cf75-4a21-af94-a56efab1950c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:44.787584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c9179-2632-4d5d-83a5-4ea9cda7c2b9 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:44.813873 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:44.837034 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ebdb1-7bc5-40af-9c42-67d64d832fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:44.838235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ebdb1-7bc5-40af-9c42-67d64d832fba None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:44.839428 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ebdb1-7bc5-40af-9c42-67d64d832fba None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:44.840095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ebdb1-7bc5-40af-9c42-67d64d832fba None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:44.842772 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ebdb1-7bc5-40af-9c42-67d64d832fba None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:44.845383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ebdb1-7bc5-40af-9c42-67d64d832fba None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:44.851312 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 188/376] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:44 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:44.856845 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ebdb1-7bc5-40af-9c42-67d64d832fba None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:44.958890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6696c-cf75-4a21-af94-a56efab1950c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:45.015448 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f3490-3849-4567-b0d8-e59075ffdcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:45.016085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f3490-3849-4567-b0d8-e59075ffdcba None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:45.016360 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f3490-3849-4567-b0d8-e59075ffdcba None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:45.016629 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f3490-3849-4567-b0d8-e59075ffdcba None admin] PATH_INFO: `/v3/projects/cf0b8451292a4b79a7b878d287636467` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:45.019517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f3490-3849-4567-b0d8-e59075ffdcba None admin] RBAC: Authorizing `identity:get_project(project_id=cf0b8451292a4b79a7b878d287636467)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:45.020884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f3490-3849-4567-b0d8-e59075ffdcba None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:45.024059 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 189/377] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:44 2022] GET /identity/v3/projects/cf0b8451292a4b79a7b878d287636467 => generated 344 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:45.028972 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f3490-3849-4567-b0d8-e59075ffdcba None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:45.042391 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ebdb1-7bc5-40af-9c42-67d64d832fba None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:45.080043 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:45.110907 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c5f37-9fdf-48b2-aff3-2752f8f9963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:45.111540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c5f37-9fdf-48b2-aff3-2752f8f9963a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:45.111817 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c5f37-9fdf-48b2-aff3-2752f8f9963a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:45.112124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c5f37-9fdf-48b2-aff3-2752f8f9963a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:45.112868 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c5f37-9fdf-48b2-aff3-2752f8f9963a None admin] RBAC: Adding query filter params (group.id=c19610840119412bb5fd2348f7c1c151, role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=b33daf122f6643588023e9a918ba418b) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:45.113173 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c5f37-9fdf-48b2-aff3-2752f8f9963a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:45.115560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c5f37-9fdf-48b2-aff3-2752f8f9963a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:45.128652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 189/378] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:44 2022] GET /identity/v3/role_assignments?group.id=c19610840119412bb5fd2348f7c1c151&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:45.201055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f3490-3849-4567-b0d8-e59075ffdcba None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:45.248030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb61e2-5e2b-463d-8739-9111f36eac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:45.249263 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb61e2-5e2b-463d-8739-9111f36eac32 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:45.249548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb61e2-5e2b-463d-8739-9111f36eac32 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:45.249821 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb61e2-5e2b-463d-8739-9111f36eac32 None admin] PATH_INFO: `/v3/groups/8f5318572a044e4a86f1931f73e988e0` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:45.267828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb61e2-5e2b-463d-8739-9111f36eac32 None admin] RBAC: Authorizing `identity:get_group(group_id=8f5318572a044e4a86f1931f73e988e0)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:45.269320 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb61e2-5e2b-463d-8739-9111f36eac32 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:45.271300 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 190/379] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:45 2022] GET /identity/v3/groups/8f5318572a044e4a86f1931f73e988e0 => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:45.277806 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c5f37-9fdf-48b2-aff3-2752f8f9963a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:45.343666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:45.391473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c5f37-9fdf-48b2-aff3-2752f8f9963a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:45.444296 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907354e-8b8a-43f3-ae37-615d67847721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:45.444944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907354e-8b8a-43f3-ae37-615d67847721 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:45.445195 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907354e-8b8a-43f3-ae37-615d67847721 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:45.445465 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907354e-8b8a-43f3-ae37-615d67847721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:45.446204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907354e-8b8a-43f3-ae37-615d67847721 None admin] RBAC: Adding query filter params (group.id=8f5318572a044e4a86f1931f73e988e0, role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=cf0b8451292a4b79a7b878d287636467) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:45.446510 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907354e-8b8a-43f3-ae37-615d67847721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:45.447966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907354e-8b8a-43f3-ae37-615d67847721 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:45.459548 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 190/380] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:45 2022] GET /identity/v3/role_assignments?group.id=8f5318572a044e4a86f1931f73e988e0&scope.project.id=cf0b8451292a4b79a7b878d287636467&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:45.815683 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9012e-706d-47b0-8677-d36823547700 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:45.816204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9012e-706d-47b0-8677-d36823547700 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:45.816204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9012e-706d-47b0-8677-d36823547700 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:45.817798 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 191/381] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:45.823784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dec4a-3b9d-4232-a626-a3171d266efd None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:45.824072 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dec4a-3b9d-4232-a626-a3171d266efd None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:45.824412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dec4a-3b9d-4232-a626-a3171d266efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:45.844892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-e82dec4a-3b9d-4232-a626-a3171d266efd None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:45.846090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-e82dec4a-3b9d-4232-a626-a3171d266efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:45.920717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 191/382] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:46.388525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2adb75-bc07-45e2-9001-47fc6b33052c None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:46.388718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2adb75-bc07-45e2-9001-47fc6b33052c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:46.388984 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2adb75-bc07-45e2-9001-47fc6b33052c None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:46.391485 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 192/383] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:46.396938 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ab2e5-71a5-4427-aa8b-bf62d91b205e None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:46.397496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ab2e5-71a5-4427-aa8b-bf62d91b205e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:46.397971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ab2e5-71a5-4427-aa8b-bf62d91b205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:46.418017 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-cf3ab2e5-71a5-4427-aa8b-bf62d91b205e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:46.419631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-cf3ab2e5-71a5-4427-aa8b-bf62d91b205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:46.470766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:46.483866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2adb75-bc07-45e2-9001-47fc6b33052c None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:46.516776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 192/384] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:46.612018 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:46.622392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2adb75-bc07-45e2-9001-47fc6b33052c None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:46.667769 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22095cc0-f092-4bc3-a17c-35bde2638c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:46.668321 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22095cc0-f092-4bc3-a17c-35bde2638c27 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:46.668660 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22095cc0-f092-4bc3-a17c-35bde2638c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:46.668937 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22095cc0-f092-4bc3-a17c-35bde2638c27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:46.683129 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22095cc0-f092-4bc3-a17c-35bde2638c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-22095cc0-f092-4bc3-a17c-35bde2638c27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:46.688725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:46.689701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:46.690535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 193/385] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:46.695578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ab2e5-71a5-4427-aa8b-bf62d91b205e None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:46.708869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c798-14ac-42a7-b978-bd2547fed01e None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:46.709158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c798-14ac-42a7-b978-bd2547fed01e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:46.709446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93c798-14ac-42a7-b978-bd2547fed01e None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:46.710761 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 194/386] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:46.721900 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8a21e-1020-45c3-9f5c-947e6928354c None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:46.722188 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8a21e-1020-45c3-9f5c-947e6928354c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:46.722472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8a21e-1020-45c3-9f5c-947e6928354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:46.754777 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-86d8a21e-1020-45c3-9f5c-947e6928354c None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:46.757346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-86d8a21e-1020-45c3-9f5c-947e6928354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:46.857464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ab2e5-71a5-4427-aa8b-bf62d91b205e None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:46.858577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 195/387] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 03 14:38:46.859644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8a21e-1020-45c3-9f5c-947e6928354c None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:46.922596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f2d75-fc51-4292-aa35-edc0afca42e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:46.923152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f2d75-fc51-4292-aa35-edc0afca42e7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:46.923427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f2d75-fc51-4292-aa35-edc0afca42e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:46.923692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f2d75-fc51-4292-aa35-edc0afca42e7 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:46.924347 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f2d75-fc51-4292-aa35-edc0afca42e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:46.924646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f2d75-fc51-4292-aa35-edc0afca42e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:46.926148 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f2d75-fc51-4292-aa35-edc0afca42e7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:46.942775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 193/388] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:46.948454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f2d75-fc51-4292-aa35-edc0afca42e7 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:46.993759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:47.008309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:47.030855 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8a21e-1020-45c3-9f5c-947e6928354c None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:47.067462 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f2d75-fc51-4292-aa35-edc0afca42e7 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:47.105726 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5f00b-edfe-4026-885c-426de008f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:47.107444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5f00b-edfe-4026-885c-426de008f784 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:47.108482 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5f00b-edfe-4026-885c-426de008f784 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:47.109802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5f00b-edfe-4026-885c-426de008f784 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:47.112337 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5f00b-edfe-4026-885c-426de008f784 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:47.114454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5f00b-edfe-4026-885c-426de008f784 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:47.116730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 194/389] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:46 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:47.123739 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732dad1-12d1-4129-b710-870062d9d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:47.124444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732dad1-12d1-4129-b710-870062d9d4ca None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:47.124730 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732dad1-12d1-4129-b710-870062d9d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:47.125010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732dad1-12d1-4129-b710-870062d9d4ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:47.125607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5f00b-edfe-4026-885c-426de008f784 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:47.145322 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732dad1-12d1-4129-b710-870062d9d4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-7732dad1-12d1-4129-b710-870062d9d4ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:47.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:47.151152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:47.151968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 196/390] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:47.158752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732dad1-12d1-4129-b710-870062d9d4ca None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:47.284736 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5f00b-edfe-4026-885c-426de008f784 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:47.296917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:47.297837 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732dad1-12d1-4129-b710-870062d9d4ca None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:47.324289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dfc36-7bab-44e9-b672-b7732fab40fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:47.325250 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dfc36-7bab-44e9-b672-b7732fab40fd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:47.325589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dfc36-7bab-44e9-b672-b7732fab40fd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:47.326157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dfc36-7bab-44e9-b672-b7732fab40fd None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:47.327403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dfc36-7bab-44e9-b672-b7732fab40fd None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:47.328890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153dfc36-7bab-44e9-b672-b7732fab40fd None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:47.330824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 195/391] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:47 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:47.331627 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dfc36-7bab-44e9-b672-b7732fab40fd None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:47.338470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ee245-e1c3-4d6d-97a1-9abbe7420dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:47.339249 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ee245-e1c3-4d6d-97a1-9abbe7420dea None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:47.339635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ee245-e1c3-4d6d-97a1-9abbe7420dea None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:47.340062 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ee245-e1c3-4d6d-97a1-9abbe7420dea None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:47.340831 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ee245-e1c3-4d6d-97a1-9abbe7420dea None admin] RBAC: Adding query filter params (name=member) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:47.341236 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ee245-e1c3-4d6d-97a1-9abbe7420dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:47.343250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ee245-e1c3-4d6d-97a1-9abbe7420dea None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:47.351892 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 197/392] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:47.352818 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ee245-e1c3-4d6d-97a1-9abbe7420dea None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:47.356591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:47.445835 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dfc36-7bab-44e9-b672-b7732fab40fd None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:47.465228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ee245-e1c3-4d6d-97a1-9abbe7420dea None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:47.484161 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fba1e-7055-4bad-bfd7-6db172e056f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:47.484879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fba1e-7055-4bad-bfd7-6db172e056f0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:47.485095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fba1e-7055-4bad-bfd7-6db172e056f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:47.485385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fba1e-7055-4bad-bfd7-6db172e056f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:47.500804 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fba1e-7055-4bad-bfd7-6db172e056f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-685fba1e-7055-4bad-bfd7-6db172e056f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:47.507151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:47.508052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:47.508860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 196/393] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:47.509523 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fba1e-7055-4bad-bfd7-6db172e056f0 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:47.522257 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afca8b-4a7e-4005-a622-b4bec97c277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:47.523404 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afca8b-4a7e-4005-a622-b4bec97c277a None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:47.523885 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afca8b-4a7e-4005-a622-b4bec97c277a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:47.524458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afca8b-4a7e-4005-a622-b4bec97c277a None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/groups/c19610840119412bb5fd2348f7c1c151/roles/44e0a79b0d8942bbb803f5a4cb669d6e` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:47.527218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afca8b-4a7e-4005-a622-b4bec97c277a None admin] RBAC: Authorizing `identity:create_grant(project_id=d3c937f73cf7454483a3ae2f627fad5a, group_id=c19610840119412bb5fd2348f7c1c151, role_id=44e0a79b0d8942bbb803f5a4cb669d6e)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:47.529013 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afca8b-4a7e-4005-a622-b4bec97c277a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:47.550048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 198/394] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Oct 3 14:38:47 2022] PUT /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/groups/c19610840119412bb5fd2348f7c1c151/roles/44e0a79b0d8942bbb803f5a4cb669d6e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:47.551248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afca8b-4a7e-4005-a622-b4bec97c277a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:47.565381 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:47.682176 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:47.743462 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fba1e-7055-4bad-bfd7-6db172e056f0 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:47.761698 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afca8b-4a7e-4005-a622-b4bec97c277a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:47.794787 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c01173-b8f7-4456-a256-fb3606eb43b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:47.797018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c01173-b8f7-4456-a256-fb3606eb43b0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:47.798065 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c01173-b8f7-4456-a256-fb3606eb43b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:47.798858 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c01173-b8f7-4456-a256-fb3606eb43b0 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:47.800651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c01173-b8f7-4456-a256-fb3606eb43b0 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:47.803147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c01173-b8f7-4456-a256-fb3606eb43b0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:47.806236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 197/395] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:47 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:47.813418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c01173-b8f7-4456-a256-fb3606eb43b0 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:47.814430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628872-a7c5-4aaf-829c-ceb59f57ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:47.815099 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628872-a7c5-4aaf-829c-ceb59f57ec44 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:47.816600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628872-a7c5-4aaf-829c-ceb59f57ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:47.816830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628872-a7c5-4aaf-829c-ceb59f57ec44 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:47.817537 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84628872-a7c5-4aaf-829c-ceb59f57ec44 None admin] RBAC: Adding query filter params (name=member) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:47.817848 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84628872-a7c5-4aaf-829c-ceb59f57ec44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:47.823375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84628872-a7c5-4aaf-829c-ceb59f57ec44 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:47.843498 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 199/396] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:47.849445 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628872-a7c5-4aaf-829c-ceb59f57ec44 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:47.978856 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c01173-b8f7-4456-a256-fb3606eb43b0 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:47.982033 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:48.015704 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628872-a7c5-4aaf-829c-ceb59f57ec44 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:48.023852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab27c9-cdfd-4aca-bfd4-12d211cee17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:48.024651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab27c9-cdfd-4aca-bfd4-12d211cee17a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.025068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab27c9-cdfd-4aca-bfd4-12d211cee17a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.025412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab27c9-cdfd-4aca-bfd4-12d211cee17a None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.027256 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab27c9-cdfd-4aca-bfd4-12d211cee17a None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:48.028796 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab27c9-cdfd-4aca-bfd4-12d211cee17a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:48.031081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 198/397] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:47 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:48.032474 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e32da3-5523-4c38-a044-8210dc9cb832 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.032831 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e32da3-5523-4c38-a044-8210dc9cb832 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.033303 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e32da3-5523-4c38-a044-8210dc9cb832 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.035231 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 199/398] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:48.036852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e32da3-5523-4c38-a044-8210dc9cb832 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:48.054259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:48.068126 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d629ea-6f01-4dcb-b939-fb0ef9822a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:48.069047 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d629ea-6f01-4dcb-b939-fb0ef9822a81 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.069332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d629ea-6f01-4dcb-b939-fb0ef9822a81 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.070068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d629ea-6f01-4dcb-b939-fb0ef9822a81 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.071536 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d629ea-6f01-4dcb-b939-fb0ef9822a81 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:48.073989 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d629ea-6f01-4dcb-b939-fb0ef9822a81 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:48.076172 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 200/399] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:47 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:48.077437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425fa42-dad3-490c-b9ea-83bf7f34dc09 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.077726 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425fa42-dad3-490c-b9ea-83bf7f34dc09 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.078003 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425fa42-dad3-490c-b9ea-83bf7f34dc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.106095 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-3425fa42-dad3-490c-b9ea-83bf7f34dc09 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:48.107446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-3425fa42-dad3-490c-b9ea-83bf7f34dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:48.170308 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e32da3-5523-4c38-a044-8210dc9cb832 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:48.190979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 201/400] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:48.190979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425fa42-dad3-490c-b9ea-83bf7f34dc09 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:48.215283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4a731-92c3-43cb-9567-88c8500c1fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:48.215950 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a731-92c3-43cb-9567-88c8500c1fb7 None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.216232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a731-92c3-43cb-9567-88c8500c1fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.216505 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4a731-92c3-43cb-9567-88c8500c1fb7 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b/groups/c19610840119412bb5fd2348f7c1c151/roles/5039147f7bed444380ba0a7d7b6c2269` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.221165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4a731-92c3-43cb-9567-88c8500c1fb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b33daf122f6643588023e9a918ba418b, group_id=c19610840119412bb5fd2348f7c1c151, role_id=5039147f7bed444380ba0a7d7b6c2269)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:48.222617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4a731-92c3-43cb-9567-88c8500c1fb7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:48.247062 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 200/401] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Oct 3 14:38:48 2022] PUT /identity/v3/projects/b33daf122f6643588023e9a918ba418b/groups/c19610840119412bb5fd2348f7c1c151/roles/5039147f7bed444380ba0a7d7b6c2269 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:48.249088 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a82c33-f7a1-490c-9340-ed1e4d31fc69 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.249560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a82c33-f7a1-490c-9340-ed1e4d31fc69 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.249902 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a82c33-f7a1-490c-9340-ed1e4d31fc69 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.251261 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 201/402] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:48.261064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced811c-b79f-4755-8413-bc0fa04dbffd None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.261064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced811c-b79f-4755-8413-bc0fa04dbffd None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.261343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced811c-b79f-4755-8413-bc0fa04dbffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.298831 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-2ced811c-b79f-4755-8413-bc0fa04dbffd None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:48.300167 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-2ced811c-b79f-4755-8413-bc0fa04dbffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:48.316375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425fa42-dad3-490c-b9ea-83bf7f34dc09 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:48.345122 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:48.352582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:48.360258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07e84-3abe-4767-99b3-7d023656c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:48.361276 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07e84-3abe-4767-99b3-7d023656c49d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.361763 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07e84-3abe-4767-99b3-7d023656c49d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.362263 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07e84-3abe-4767-99b3-7d023656c49d None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.363772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab07e84-3abe-4767-99b3-7d023656c49d None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:48.365936 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab07e84-3abe-4767-99b3-7d023656c49d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:48.368067 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 202/403] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:48 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:48.375301 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07e84-3abe-4767-99b3-7d023656c49d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:48.439869 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 202/404] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:48.511103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07e84-3abe-4767-99b3-7d023656c49d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:48.519252 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced811c-b79f-4755-8413-bc0fa04dbffd None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:48.573105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e8c2-218f-4c3e-b8fd-8f5ee7450c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:48.573716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e8c2-218f-4c3e-b8fd-8f5ee7450c10 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.574001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e8c2-218f-4c3e-b8fd-8f5ee7450c10 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.574279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e8c2-218f-4c3e-b8fd-8f5ee7450c10 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/groups/c19610840119412bb5fd2348f7c1c151/roles/5039147f7bed444380ba0a7d7b6c2269` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.576346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e8c2-218f-4c3e-b8fd-8f5ee7450c10 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3c937f73cf7454483a3ae2f627fad5a, group_id=c19610840119412bb5fd2348f7c1c151, role_id=5039147f7bed444380ba0a7d7b6c2269)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:48.578614 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e8c2-218f-4c3e-b8fd-8f5ee7450c10 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:48.606125 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 203/405] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Oct 3 14:38:48 2022] PUT /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a/groups/c19610840119412bb5fd2348f7c1c151/roles/5039147f7bed444380ba0a7d7b6c2269 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 14:38:48.669014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced811c-b79f-4755-8413-bc0fa04dbffd None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:48.708367 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d2b7-1b31-42ca-bd70-ad461369b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:48.709018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d2b7-1b31-42ca-bd70-ad461369b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.709299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d2b7-1b31-42ca-bd70-ad461369b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.709572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d2b7-1b31-42ca-bd70-ad461369b9b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.723313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85d2b7-1b31-42ca-bd70-ad461369b9b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-4a85d2b7-1b31-42ca-bd70-ad461369b9b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:48.728443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:48.729438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:48.730253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:48.735079 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 203/406] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:38:48.736714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e8c2-218f-4c3e-b8fd-8f5ee7450c10 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:48.803298 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:48.816964 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d2b7-1b31-42ca-bd70-ad461369b9b6 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:48.851368 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:48.870125 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e8c2-218f-4c3e-b8fd-8f5ee7450c10 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:48.909366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e86d8-1ddd-4807-968c-833380db8ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:48.909991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e86d8-1ddd-4807-968c-833380db8ec1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.910275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e86d8-1ddd-4807-968c-833380db8ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.910554 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e86d8-1ddd-4807-968c-833380db8ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.911256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e86d8-1ddd-4807-968c-833380db8ec1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:48.911566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e86d8-1ddd-4807-968c-833380db8ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:48.912943 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e86d8-1ddd-4807-968c-833380db8ec1 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:48.923712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 204/407] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:48.929957 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e86d8-1ddd-4807-968c-833380db8ec1 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:48.944943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d2b7-1b31-42ca-bd70-ad461369b9b6 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:48.982376 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b31c68-0503-4829-9157-3b68e3e3a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:48.983436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31c68-0503-4829-9157-3b68e3e3a367 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:48.983790 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31c68-0503-4829-9157-3b68e3e3a367 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:48.984137 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31c68-0503-4829-9157-3b68e3e3a367 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:48.995680 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b31c68-0503-4829-9157-3b68e3e3a367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-24b31c68-0503-4829-9157-3b68e3e3a367 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:49.002470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:49.003412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:49.004207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 204/408] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:38:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:49.015917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b31c68-0503-4829-9157-3b68e3e3a367 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:49.105059 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e86d8-1ddd-4807-968c-833380db8ec1 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:49.125821 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:49.166602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf50dfc-f544-4493-8b56-86a1f6c4d7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:49.167848 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50dfc-f544-4493-8b56-86a1f6c4d7a3 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:49.169013 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:49.169834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50dfc-f544-4493-8b56-86a1f6c4d7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:49.171745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50dfc-f544-4493-8b56-86a1f6c4d7a3 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:49.173096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf50dfc-f544-4493-8b56-86a1f6c4d7a3 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:49.174857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf50dfc-f544-4493-8b56-86a1f6c4d7a3 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:49.178706 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 205/409] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:48 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:49.187950 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf50dfc-f544-4493-8b56-86a1f6c4d7a3 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:49.199021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b31c68-0503-4829-9157-3b68e3e3a367 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:49.242701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705fdfb-2f02-4a1a-86c1-ec9ea261f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:49.243420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705fdfb-2f02-4a1a-86c1-ec9ea261f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:49.243702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705fdfb-2f02-4a1a-86c1-ec9ea261f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:49.243977 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705fdfb-2f02-4a1a-86c1-ec9ea261f2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:49.244701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705fdfb-2f02-4a1a-86c1-ec9ea261f2e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:49.245012 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705fdfb-2f02-4a1a-86c1-ec9ea261f2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:49.246912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705fdfb-2f02-4a1a-86c1-ec9ea261f2e0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:49.262342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 205/410] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:49.268612 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705fdfb-2f02-4a1a-86c1-ec9ea261f2e0 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:49.380120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf50dfc-f544-4493-8b56-86a1f6c4d7a3 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:49.442711 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705fdfb-2f02-4a1a-86c1-ec9ea261f2e0 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:49.448565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2c97-faa4-458b-9713-5ebc261bcf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:49.449211 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2c97-faa4-458b-9713-5ebc261bcf43 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:49.449493 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2c97-faa4-458b-9713-5ebc261bcf43 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:49.449770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2c97-faa4-458b-9713-5ebc261bcf43 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:49.456786 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f2c97-faa4-458b-9713-5ebc261bcf43 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:49.458228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f2c97-faa4-458b-9713-5ebc261bcf43 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:49.460091 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 206/411] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:49 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:49.484834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2c97-faa4-458b-9713-5ebc261bcf43 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:49.516699 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0465b29-9eda-4009-aeea-16a61574dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:49.517341 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0465b29-9eda-4009-aeea-16a61574dd26 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:49.517619 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0465b29-9eda-4009-aeea-16a61574dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:49.517887 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0465b29-9eda-4009-aeea-16a61574dd26 None admin] PATH_INFO: `/v3/groups/8f5318572a044e4a86f1931f73e988e0` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:49.519072 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0465b29-9eda-4009-aeea-16a61574dd26 None admin] RBAC: Authorizing `identity:get_group(group_id=8f5318572a044e4a86f1931f73e988e0)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:49.520498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0465b29-9eda-4009-aeea-16a61574dd26 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:49.523105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 206/412] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:49 2022] GET /identity/v3/groups/8f5318572a044e4a86f1931f73e988e0 => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:49.527762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0465b29-9eda-4009-aeea-16a61574dd26 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:49.557072 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:49.558299 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:49.648696 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2c97-faa4-458b-9713-5ebc261bcf43 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:49.711409 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fff3b-f53c-4d16-ab37-91cf9cd6c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:49.712456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fff3b-f53c-4d16-ab37-91cf9cd6c73c None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:49.712934 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fff3b-f53c-4d16-ab37-91cf9cd6c73c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:49.713400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fff3b-f53c-4d16-ab37-91cf9cd6c73c None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b/groups/c19610840119412bb5fd2348f7c1c151/roles/44e0a79b0d8942bbb803f5a4cb669d6e` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:49.717999 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fff3b-f53c-4d16-ab37-91cf9cd6c73c None admin] RBAC: Authorizing `identity:create_grant(project_id=b33daf122f6643588023e9a918ba418b, group_id=c19610840119412bb5fd2348f7c1c151, role_id=44e0a79b0d8942bbb803f5a4cb669d6e)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:49.720288 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fff3b-f53c-4d16-ab37-91cf9cd6c73c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:49.729819 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0465b29-9eda-4009-aeea-16a61574dd26 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:49.744279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 207/413] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Oct 3 14:38:49 2022] PUT /identity/v3/projects/b33daf122f6643588023e9a918ba418b/groups/c19610840119412bb5fd2348f7c1c151/roles/44e0a79b0d8942bbb803f5a4cb669d6e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 14:38:49.774771 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2596a-7da6-4596-8ba6-6552bf09fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:49.775843 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2596a-7da6-4596-8ba6-6552bf09fa9e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:49.776323 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2596a-7da6-4596-8ba6-6552bf09fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:49.776818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2596a-7da6-4596-8ba6-6552bf09fa9e None admin] PATH_INFO: `/v3/projects/cf0b8451292a4b79a7b878d287636467` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:49.778236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2596a-7da6-4596-8ba6-6552bf09fa9e None admin] RBAC: Authorizing `identity:get_project(project_id=cf0b8451292a4b79a7b878d287636467)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:49.780481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2596a-7da6-4596-8ba6-6552bf09fa9e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:49.783596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 207/414] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:49 2022] GET /identity/v3/projects/cf0b8451292a4b79a7b878d287636467 => generated 344 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:49.792120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fff3b-f53c-4d16-ab37-91cf9cd6c73c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:49.932370 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fff3b-f53c-4d16-ab37-91cf9cd6c73c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:49.949864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:49.986747 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed5b59-7444-46f3-90a9-784e52a67700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:49.987515 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed5b59-7444-46f3-90a9-784e52a67700 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:49.987802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed5b59-7444-46f3-90a9-784e52a67700 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:49.988080 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed5b59-7444-46f3-90a9-784e52a67700 None admin] PATH_INFO: `/v3/projects/cf0b8451292a4b79a7b878d287636467/groups/8f5318572a044e4a86f1931f73e988e0/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:49.993477 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed5b59-7444-46f3-90a9-784e52a67700 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf0b8451292a4b79a7b878d287636467, group_id=8f5318572a044e4a86f1931f73e988e0, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:49.994940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed5b59-7444-46f3-90a9-784e52a67700 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:50.011705 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 208/415] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Oct 3 14:38:49 2022] PUT /identity/v3/projects/cf0b8451292a4b79a7b878d287636467/groups/8f5318572a044e4a86f1931f73e988e0/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:38:50.147507 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9640a-aa7d-4274-b54d-754878e9a645 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:50.147837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9640a-aa7d-4274-b54d-754878e9a645 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:50.148067 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9640a-aa7d-4274-b54d-754878e9a645 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:50.149633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 208/416] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:50.156002 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae88f3-b38c-4650-b0fc-3fd681834382 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:50.156536 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae88f3-b38c-4650-b0fc-3fd681834382 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:50.156536 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae88f3-b38c-4650-b0fc-3fd681834382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:50.178540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a0ae88f3-b38c-4650-b0fc-3fd681834382 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:50.179773 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a0ae88f3-b38c-4650-b0fc-3fd681834382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:50.263604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 209/417] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:50.610837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9640a-aa7d-4274-b54d-754878e9a645 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:50.723211 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:50.748261 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9640a-aa7d-4274-b54d-754878e9a645 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:50.797716 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f888f25-b13c-4347-ab62-a4fbbe4bcd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:50.798353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f888f25-b13c-4347-ab62-a4fbbe4bcd93 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:50.798630 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f888f25-b13c-4347-ab62-a4fbbe4bcd93 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:50.798902 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f888f25-b13c-4347-ab62-a4fbbe4bcd93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:50.812356 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f888f25-b13c-4347-ab62-a4fbbe4bcd93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-6f888f25-b13c-4347-ab62-a4fbbe4bcd93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:50.817204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:50.818070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:50.819496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 209/418] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:50.824097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae88f3-b38c-4650-b0fc-3fd681834382 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:50.971333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:50.978036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae88f3-b38c-4650-b0fc-3fd681834382 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:51.030959 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b8286-bc97-4fc6-9a5a-3963a45065bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:51.031577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8286-bc97-4fc6-9a5a-3963a45065bf None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:51.031857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8286-bc97-4fc6-9a5a-3963a45065bf None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:51.032126 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8286-bc97-4fc6-9a5a-3963a45065bf None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:51.032790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b8286-bc97-4fc6-9a5a-3963a45065bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:51.033086 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b8286-bc97-4fc6-9a5a-3963a45065bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:51.034444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b8286-bc97-4fc6-9a5a-3963a45065bf None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:51.048249 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 210/419] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:51.053714 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f888f25-b13c-4347-ab62-a4fbbe4bcd93 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:51.081064 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f107411-eee4-4c28-931f-176b5cb10b8e None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:51.081777 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f107411-eee4-4c28-931f-176b5cb10b8e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:51.082256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f107411-eee4-4c28-931f-176b5cb10b8e None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:51.085155 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 211/420] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:51.093170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c35b2-007b-44ff-9f47-782317bcd1d7 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:51.093851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c35b2-007b-44ff-9f47-782317bcd1d7 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:51.094345 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c35b2-007b-44ff-9f47-782317bcd1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:51.135495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-393c35b2-007b-44ff-9f47-782317bcd1d7 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:51.137100 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-393c35b2-007b-44ff-9f47-782317bcd1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:51.249912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f888f25-b13c-4347-ab62-a4fbbe4bcd93 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:51.281248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 212/421] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:51.281248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4219cb3-1220-4fb3-9036-ebe77b9968bd None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:51.281248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4219cb3-1220-4fb3-9036-ebe77b9968bd None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:51.281248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4219cb3-1220-4fb3-9036-ebe77b9968bd None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:51.290561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 213/422] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:51.290561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27d7c0-2d17-401f-aeed-012bf275e51a None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:51.290561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27d7c0-2d17-401f-aeed-012bf275e51a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:51.290561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27d7c0-2d17-401f-aeed-012bf275e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:51.304975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefd506-1a41-49f4-94d6-7a80cfe5c630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:51.305950 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefd506-1a41-49f4-94d6-7a80cfe5c630 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:51.306234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefd506-1a41-49f4-94d6-7a80cfe5c630 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:51.306506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefd506-1a41-49f4-94d6-7a80cfe5c630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:51.318981 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-1e27d7c0-2d17-401f-aeed-012bf275e51a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:51.320454 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-1e27d7c0-2d17-401f-aeed-012bf275e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:51.344467 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:51.448491 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 214/423] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:51.460021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefd506-1a41-49f4-94d6-7a80cfe5c630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:51.461494 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefd506-1a41-49f4-94d6-7a80cfe5c630 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:51.595616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27d7c0-2d17-401f-aeed-012bf275e51a None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:51.605228 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 210/424] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:51.611741 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefd506-1a41-49f4-94d6-7a80cfe5c630 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:51.626186 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:51.694080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:51.720907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27d7c0-2d17-401f-aeed-012bf275e51a None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:51.776163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9326211-1265-487b-9d08-ecfeac977ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:51.776840 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9326211-1265-487b-9d08-ecfeac977ab4 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:51.777298 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9326211-1265-487b-9d08-ecfeac977ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:51.777580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9326211-1265-487b-9d08-ecfeac977ab4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:51.781359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefd506-1a41-49f4-94d6-7a80cfe5c630 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:51.790206 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9326211-1265-487b-9d08-ecfeac977ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e9326211-1265-487b-9d08-ecfeac977ab4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:51.797557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:51.798468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 215/425] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:51.803901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9326211-1265-487b-9d08-ecfeac977ab4 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:51.832342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad6273-366c-4846-a06a-3a4f3449680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:51.832978 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad6273-366c-4846-a06a-3a4f3449680f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:51.833498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad6273-366c-4846-a06a-3a4f3449680f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:51.833781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad6273-366c-4846-a06a-3a4f3449680f None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:51.835375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad6273-366c-4846-a06a-3a4f3449680f None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:51.837315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad6273-366c-4846-a06a-3a4f3449680f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:51.839909 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 211/426] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:51 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:51.840669 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad6273-366c-4846-a06a-3a4f3449680f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:51.893095 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:51.913258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9326211-1265-487b-9d08-ecfeac977ab4 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:51.951185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db057b2-86b6-4e80-9a3c-17cfb99feb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:51.952256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db057b2-86b6-4e80-9a3c-17cfb99feb34 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:51.952843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db057b2-86b6-4e80-9a3c-17cfb99feb34 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:51.953315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db057b2-86b6-4e80-9a3c-17cfb99feb34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:51.964183 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db057b2-86b6-4e80-9a3c-17cfb99feb34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-4db057b2-86b6-4e80-9a3c-17cfb99feb34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:51.970030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:51.970940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 14:38:51.971870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:51.972962 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad6273-366c-4846-a06a-3a4f3449680f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:51.974622 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 216/427] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:51.975730 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db057b2-86b6-4e80-9a3c-17cfb99feb34 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:51.987745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:52.017952 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740b491-6638-43ce-805a-e7585c9b651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:52.018898 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b491-6638-43ce-805a-e7585c9b651f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.019440 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b491-6638-43ce-805a-e7585c9b651f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.019911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b491-6638-43ce-805a-e7585c9b651f None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.020763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740b491-6638-43ce-805a-e7585c9b651f None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:52.021262 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740b491-6638-43ce-805a-e7585c9b651f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:52.022987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740b491-6638-43ce-805a-e7585c9b651f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:52.032641 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 212/428] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:52.038461 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740b491-6638-43ce-805a-e7585c9b651f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:52.105439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db057b2-86b6-4e80-9a3c-17cfb99feb34 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:52.142405 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f00abd-ac67-4fed-ba2c-c67b36aeb19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:52.143507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f00abd-ac67-4fed-ba2c-c67b36aeb19f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.143992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f00abd-ac67-4fed-ba2c-c67b36aeb19f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.144467 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f00abd-ac67-4fed-ba2c-c67b36aeb19f None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.145835 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f00abd-ac67-4fed-ba2c-c67b36aeb19f None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:52.147503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f00abd-ac67-4fed-ba2c-c67b36aeb19f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:52.149677 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 217/429] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:51 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:52.150788 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f00abd-ac67-4fed-ba2c-c67b36aeb19f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:52.165007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:52.171306 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740b491-6638-43ce-805a-e7585c9b651f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:52.211294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c8237-8da6-435b-b1ba-f8800158677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:52.212284 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c8237-8da6-435b-b1ba-f8800158677a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.212764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c8237-8da6-435b-b1ba-f8800158677a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.213231 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c8237-8da6-435b-b1ba-f8800158677a None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.214162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c8237-8da6-435b-b1ba-f8800158677a None admin] RBAC: Adding query filter params (name=member) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:52.214672 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c8237-8da6-435b-b1ba-f8800158677a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:52.216288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c8237-8da6-435b-b1ba-f8800158677a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:52.225913 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 213/430] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:38:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:52.227432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c8237-8da6-435b-b1ba-f8800158677a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:52.265270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:52.271863 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f00abd-ac67-4fed-ba2c-c67b36aeb19f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:52.307051 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea6bf8-ce84-4a0e-9d47-91b2bbcd7fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:52.307704 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea6bf8-ce84-4a0e-9d47-91b2bbcd7fa8 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.307929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea6bf8-ce84-4a0e-9d47-91b2bbcd7fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.308187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea6bf8-ce84-4a0e-9d47-91b2bbcd7fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.345717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c8237-8da6-435b-b1ba-f8800158677a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:52.380218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea6bf8-ce84-4a0e-9d47-91b2bbcd7fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:52.381870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea6bf8-ce84-4a0e-9d47-91b2bbcd7fa8 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:52.383763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bb4a8-64da-4396-abed-9ff41ffe4e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:52.384600 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bb4a8-64da-4396-abed-9ff41ffe4e04 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.385081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bb4a8-64da-4396-abed-9ff41ffe4e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.385574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bb4a8-64da-4396-abed-9ff41ffe4e04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.386631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bb4a8-64da-4396-abed-9ff41ffe4e04 None admin] RBAC: Adding query filter params (group.id=c19610840119412bb5fd2348f7c1c151, role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:52.387184 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bb4a8-64da-4396-abed-9ff41ffe4e04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:52.388808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bb4a8-64da-4396-abed-9ff41ffe4e04 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:52.394357 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:52.396874 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 214/431] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:52 2022] GET /identity/v3/role_assignments?group.id=c19610840119412bb5fd2348f7c1c151&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:52.398493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bb4a8-64da-4396-abed-9ff41ffe4e04 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:52.497689 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 218/432] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:52.500955 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea6bf8-ce84-4a0e-9d47-91b2bbcd7fa8 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:52.536947 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:52.550323 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bb4a8-64da-4396-abed-9ff41ffe4e04 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:52.630116 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab79b3d-7403-4766-983f-0412e03a3eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:52.630789 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79b3d-7403-4766-983f-0412e03a3eb0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.631058 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79b3d-7403-4766-983f-0412e03a3eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.631337 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79b3d-7403-4766-983f-0412e03a3eb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.670156 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea6bf8-ce84-4a0e-9d47-91b2bbcd7fa8 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:52.687961 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:52.715038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c262e-e397-42ac-81d6-45e40d5c54dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:52.715675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c262e-e397-42ac-81d6-45e40d5c54dc None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.715956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c262e-e397-42ac-81d6-45e40d5c54dc None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.716226 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c262e-e397-42ac-81d6-45e40d5c54dc None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.718025 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c262e-e397-42ac-81d6-45e40d5c54dc None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:52.719674 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c262e-e397-42ac-81d6-45e40d5c54dc None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:52.720195 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab79b3d-7403-4766-983f-0412e03a3eb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:52.721465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 219/433] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:52 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:52.721668 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab79b3d-7403-4766-983f-0412e03a3eb0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:52.727114 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663232-de52-4842-8b37-01449d4d59cc None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.727407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663232-de52-4842-8b37-01449d4d59cc None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.727677 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97663232-de52-4842-8b37-01449d4d59cc None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.729047 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 220/434] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:52.730142 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3065cb-50fb-450e-a50f-c407aafaebcd None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.730489 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3065cb-50fb-450e-a50f-c407aafaebcd None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.730766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3065cb-50fb-450e-a50f-c407aafaebcd None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.731998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 221/435] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:52.732808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3065cb-50fb-450e-a50f-c407aafaebcd None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:52.818073 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:52.824642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 215/436] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:38:52.825873 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b58d3a-b9d9-440e-a75e-fc335d7fdd47 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.826152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b58d3a-b9d9-440e-a75e-fc335d7fdd47 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.826732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b58d3a-b9d9-440e-a75e-fc335d7fdd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.833505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3065cb-50fb-450e-a50f-c407aafaebcd None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:52.843916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-98b58d3a-b9d9-440e-a75e-fc335d7fdd47 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:52.845090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-98b58d3a-b9d9-440e-a75e-fc335d7fdd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:52.867792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8659837-dc01-4907-b9f9-4b361746af03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:52.868416 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8659837-dc01-4907-b9f9-4b361746af03 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.868695 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8659837-dc01-4907-b9f9-4b361746af03 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.868968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8659837-dc01-4907-b9f9-4b361746af03 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.870054 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8659837-dc01-4907-b9f9-4b361746af03 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:52.871754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8659837-dc01-4907-b9f9-4b361746af03 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:52.873320 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 222/437] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:52 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:52.874413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51cac6-2173-491e-9f79-267f5a199a31 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:52.874771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51cac6-2173-491e-9f79-267f5a199a31 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:52.875077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51cac6-2173-491e-9f79-267f5a199a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:52.893094 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-cd51cac6-2173-491e-9f79-267f5a199a31 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:52.894276 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-cd51cac6-2173-491e-9f79-267f5a199a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:52.912375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 216/438] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:52.913212 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b58d3a-b9d9-440e-a75e-fc335d7fdd47 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:52.947886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:52.983413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 223/439] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:52.984212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51cac6-2173-491e-9f79-267f5a199a31 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:53.019292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b58d3a-b9d9-440e-a75e-fc335d7fdd47 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.055346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:53.060407 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dee6ea-31e0-4086-88bd-ecbee1de5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.060774 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dee6ea-31e0-4086-88bd-ecbee1de5564 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.061720 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dee6ea-31e0-4086-88bd-ecbee1de5564 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.062089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dee6ea-31e0-4086-88bd-ecbee1de5564 None admin] PATH_INFO: `/v3/projects/d3c937f73cf7454483a3ae2f627fad5a` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.063384 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dee6ea-31e0-4086-88bd-ecbee1de5564 None admin] RBAC: Authorizing `identity:get_project(project_id=d3c937f73cf7454483a3ae2f627fad5a)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:53.064942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dee6ea-31e0-4086-88bd-ecbee1de5564 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:53.067054 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 217/440] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:52 2022] GET /identity/v3/projects/d3c937f73cf7454483a3ae2f627fad5a => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:53.072275 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dee6ea-31e0-4086-88bd-ecbee1de5564 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:53.094741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51cac6-2173-491e-9f79-267f5a199a31 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.131771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49047e-94d5-43bd-b148-710ef3f07696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.132628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49047e-94d5-43bd-b148-710ef3f07696 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.133053 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49047e-94d5-43bd-b148-710ef3f07696 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.133513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49047e-94d5-43bd-b148-710ef3f07696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.134427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49047e-94d5-43bd-b148-710ef3f07696 None admin] RBAC: Adding query filter params (group.id=c19610840119412bb5fd2348f7c1c151, role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=b33daf122f6643588023e9a918ba418b) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:53.134878 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49047e-94d5-43bd-b148-710ef3f07696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:53.136538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49047e-94d5-43bd-b148-710ef3f07696 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:53.143571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 224/441] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:52 2022] GET /identity/v3/role_assignments?group.id=c19610840119412bb5fd2348f7c1c151&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:53.192081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dee6ea-31e0-4086-88bd-ecbee1de5564 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.192695 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49047e-94d5-43bd-b148-710ef3f07696 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:53.237631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff89a-8e6b-4a60-bd5c-1c550699a383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.238683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff89a-8e6b-4a60-bd5c-1c550699a383 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.239994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff89a-8e6b-4a60-bd5c-1c550699a383 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.240489 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff89a-8e6b-4a60-bd5c-1c550699a383 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.242117 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:53.242973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff89a-8e6b-4a60-bd5c-1c550699a383 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:53.246421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff89a-8e6b-4a60-bd5c-1c550699a383 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:53.251065 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 218/442] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:53 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:53.256645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff89a-8e6b-4a60-bd5c-1c550699a383 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:53.314770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49047e-94d5-43bd-b148-710ef3f07696 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.330063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:53.351290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ff3e0-a18c-4a8a-a6be-8d726def872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.351929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff3e0-a18c-4a8a-a6be-8d726def872b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.352212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff3e0-a18c-4a8a-a6be-8d726def872b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.352489 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ff3e0-a18c-4a8a-a6be-8d726def872b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.365535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ff3e0-a18c-4a8a-a6be-8d726def872b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-b83ff3e0-a18c-4a8a-a6be-8d726def872b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:53.371008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:53.371921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:53.372793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:53.373508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 225/443] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:38:53.374706 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ff3e0-a18c-4a8a-a6be-8d726def872b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:53.377312 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff89a-8e6b-4a60-bd5c-1c550699a383 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.421241 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b16fe2-7fd3-4136-a994-e94f422c1d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.422374 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b16fe2-7fd3-4136-a994-e94f422c1d18 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.422663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b16fe2-7fd3-4136-a994-e94f422c1d18 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.422941 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b16fe2-7fd3-4136-a994-e94f422c1d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.423692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b16fe2-7fd3-4136-a994-e94f422c1d18 None admin] RBAC: Adding query filter params (group.id=c19610840119412bb5fd2348f7c1c151, role.id=5039147f7bed444380ba0a7d7b6c2269, scope.project.id=d3c937f73cf7454483a3ae2f627fad5a) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:53.424004 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b16fe2-7fd3-4136-a994-e94f422c1d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:53.425438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b16fe2-7fd3-4136-a994-e94f422c1d18 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:53.431605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 219/444] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:53 2022] GET /identity/v3/role_assignments?group.id=c19610840119412bb5fd2348f7c1c151&scope.project.id=d3c937f73cf7454483a3ae2f627fad5a&role.id=5039147f7bed444380ba0a7d7b6c2269 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:53.432405 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b16fe2-7fd3-4136-a994-e94f422c1d18 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:53.478923 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:53.484285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ff3e0-a18c-4a8a-a6be-8d726def872b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.524786 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17586f0f-3158-45f7-8596-191b2d9a28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.525372 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17586f0f-3158-45f7-8596-191b2d9a28b2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.525660 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17586f0f-3158-45f7-8596-191b2d9a28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.525934 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17586f0f-3158-45f7-8596-191b2d9a28b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.539584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17586f0f-3158-45f7-8596-191b2d9a28b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-17586f0f-3158-45f7-8596-191b2d9a28b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:53.544511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:53.546258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:38:53.547430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:53.551540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 226/445] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:38:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:53.552495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17586f0f-3158-45f7-8596-191b2d9a28b2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:53.557835 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b16fe2-7fd3-4136-a994-e94f422c1d18 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.585643 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:53.596529 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f41bb-dcdd-457b-90e0-c658ec639ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.597152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f41bb-dcdd-457b-90e0-c658ec639ab5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.597432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f41bb-dcdd-457b-90e0-c658ec639ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.597707 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f41bb-dcdd-457b-90e0-c658ec639ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.598365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f41bb-dcdd-457b-90e0-c658ec639ab5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:53.598667 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f41bb-dcdd-457b-90e0-c658ec639ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:53.600069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f41bb-dcdd-457b-90e0-c658ec639ab5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:53.610461 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 220/446] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:53.615881 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f41bb-dcdd-457b-90e0-c658ec639ab5 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:53.671143 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17586f0f-3158-45f7-8596-191b2d9a28b2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.710871 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2be6-bf7a-4cab-8ff2-5f7f859e8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.711510 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2be6-bf7a-4cab-8ff2-5f7f859e8e73 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.711789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2be6-bf7a-4cab-8ff2-5f7f859e8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.713614 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2be6-bf7a-4cab-8ff2-5f7f859e8e73 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.713614 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2be6-bf7a-4cab-8ff2-5f7f859e8e73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:53.713614 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2be6-bf7a-4cab-8ff2-5f7f859e8e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:53.714325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2be6-bf7a-4cab-8ff2-5f7f859e8e73 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:53.723645 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 227/447] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:38:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:53.728962 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2be6-bf7a-4cab-8ff2-5f7f859e8e73 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:53.736597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f41bb-dcdd-457b-90e0-c658ec639ab5 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.759420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:53.781473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b28f-2dd0-410f-9acb-5214819a4f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.782022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b28f-2dd0-410f-9acb-5214819a4f04 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.782306 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b28f-2dd0-410f-9acb-5214819a4f04 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.782577 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91b28f-2dd0-410f-9acb-5214819a4f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.851387 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:53.853689 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2be6-bf7a-4cab-8ff2-5f7f859e8e73 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:53.865685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91b28f-2dd0-410f-9acb-5214819a4f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:53.867166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91b28f-2dd0-410f-9acb-5214819a4f04 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:53.895784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe46d7-96a6-4e9c-a0b7-7e85d8921d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:53.896401 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe46d7-96a6-4e9c-a0b7-7e85d8921d95 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:53.896680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe46d7-96a6-4e9c-a0b7-7e85d8921d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:53.896951 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe46d7-96a6-4e9c-a0b7-7e85d8921d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:53.977182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe46d7-96a6-4e9c-a0b7-7e85d8921d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:53.978864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe46d7-96a6-4e9c-a0b7-7e85d8921d95 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:53.991005 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 221/448] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:53.998182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b28f-2dd0-410f-9acb-5214819a4f04 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:54.006848 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:54.095489 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:54.100761 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 228/449] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 14:38:54.107031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe46d7-96a6-4e9c-a0b7-7e85d8921d95 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:54.112053 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91b28f-2dd0-410f-9acb-5214819a4f04 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:54.152491 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e0ad6-e47a-4fc8-bf72-afe78525b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:54.153126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e0ad6-e47a-4fc8-bf72-afe78525b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:54.153412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e0ad6-e47a-4fc8-bf72-afe78525b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:54.153684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e0ad6-e47a-4fc8-bf72-afe78525b5e2 None admin] PATH_INFO: `/v3/projects/b33daf122f6643588023e9a918ba418b` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:54.155595 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e0ad6-e47a-4fc8-bf72-afe78525b5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=b33daf122f6643588023e9a918ba418b)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:54.157219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e0ad6-e47a-4fc8-bf72-afe78525b5e2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:54.158875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 222/450] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:53 2022] GET /identity/v3/projects/b33daf122f6643588023e9a918ba418b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:54.164317 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e0ad6-e47a-4fc8-bf72-afe78525b5e2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:54.211859 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe46d7-96a6-4e9c-a0b7-7e85d8921d95 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:54.233936 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:54.246335 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ebe1b-6f04-4a31-8d1f-44254accd6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:54.246996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ebe1b-6f04-4a31-8d1f-44254accd6ee None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:54.247352 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ebe1b-6f04-4a31-8d1f-44254accd6ee None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:54.247636 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ebe1b-6f04-4a31-8d1f-44254accd6ee None admin] PATH_INFO: `/v3/projects/cf0b8451292a4b79a7b878d287636467` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:54.249544 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ebe1b-6f04-4a31-8d1f-44254accd6ee None admin] RBAC: Authorizing `identity:get_project(project_id=cf0b8451292a4b79a7b878d287636467)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:54.251060 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ebe1b-6f04-4a31-8d1f-44254accd6ee None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:54.252665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 229/451] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:38:54 2022] GET /identity/v3/projects/cf0b8451292a4b79a7b878d287636467 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:54.258071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ebe1b-6f04-4a31-8d1f-44254accd6ee None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:54.266105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e0ad6-e47a-4fc8-bf72-afe78525b5e2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:54.301207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee3e56-72ba-4ac1-b5e8-b42886b5f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:54.301844 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3e56-72ba-4ac1-b5e8-b42886b5f058 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:54.302126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3e56-72ba-4ac1-b5e8-b42886b5f058 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:54.302395 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee3e56-72ba-4ac1-b5e8-b42886b5f058 None admin] PATH_INFO: `/v3/groups/c19610840119412bb5fd2348f7c1c151` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:54.303519 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee3e56-72ba-4ac1-b5e8-b42886b5f058 None admin] RBAC: Authorizing `identity:get_group(group_id=c19610840119412bb5fd2348f7c1c151)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:54.304933 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee3e56-72ba-4ac1-b5e8-b42886b5f058 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:54.306500 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 223/452] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:54 2022] GET /identity/v3/groups/c19610840119412bb5fd2348f7c1c151 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:54.312722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee3e56-72ba-4ac1-b5e8-b42886b5f058 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:54.337809 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:54.365592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ebe1b-6f04-4a31-8d1f-44254accd6ee None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:54.398056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67c15-29b2-4fac-bcf8-84093a9e7015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:54.398685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67c15-29b2-4fac-bcf8-84093a9e7015 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:54.398996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67c15-29b2-4fac-bcf8-84093a9e7015 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:54.399278 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce67c15-29b2-4fac-bcf8-84093a9e7015 None admin] PATH_INFO: `/v3/groups/8f5318572a044e4a86f1931f73e988e0` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:54.400382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce67c15-29b2-4fac-bcf8-84093a9e7015 None admin] RBAC: Authorizing `identity:get_group(group_id=8f5318572a044e4a86f1931f73e988e0)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:54.401808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce67c15-29b2-4fac-bcf8-84093a9e7015 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:54.403396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 230/453] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Oct 3 14:38:54 2022] GET /identity/v3/groups/8f5318572a044e4a86f1931f73e988e0 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:54.409650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67c15-29b2-4fac-bcf8-84093a9e7015 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:54.410907 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee3e56-72ba-4ac1-b5e8-b42886b5f058 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:54.444508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbfc96-97ae-4ad9-b2f3-b86cbe7d5dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:54.445105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfc96-97ae-4ad9-b2f3-b86cbe7d5dcb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:54.445383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfc96-97ae-4ad9-b2f3-b86cbe7d5dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:54.445655 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfc96-97ae-4ad9-b2f3-b86cbe7d5dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:54.446365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbfc96-97ae-4ad9-b2f3-b86cbe7d5dcb None admin] RBAC: Adding query filter params (group.id=c19610840119412bb5fd2348f7c1c151, role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=b33daf122f6643588023e9a918ba418b) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:54.446671 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbfc96-97ae-4ad9-b2f3-b86cbe7d5dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:54.448109 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbfc96-97ae-4ad9-b2f3-b86cbe7d5dcb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:54.454591 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 224/454] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:54 2022] GET /identity/v3/role_assignments?group.id=c19610840119412bb5fd2348f7c1c151&scope.project.id=b33daf122f6643588023e9a918ba418b&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:54.466853 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:54.513210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce67c15-29b2-4fac-bcf8-84093a9e7015 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:54.548646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701a8dc-5717-410e-b089-02be6d51c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:54.549264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701a8dc-5717-410e-b089-02be6d51c361 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:54.549540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701a8dc-5717-410e-b089-02be6d51c361 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:54.549809 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701a8dc-5717-410e-b089-02be6d51c361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:54.550536 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701a8dc-5717-410e-b089-02be6d51c361 None admin] RBAC: Adding query filter params (group.id=8f5318572a044e4a86f1931f73e988e0, role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=cf0b8451292a4b79a7b878d287636467) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:54.550841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701a8dc-5717-410e-b089-02be6d51c361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:54.552331 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701a8dc-5717-410e-b089-02be6d51c361 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:54.558616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 231/455] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Oct 3 14:38:54 2022] GET /identity/v3/role_assignments?group.id=8f5318572a044e4a86f1931f73e988e0&scope.project.id=cf0b8451292a4b79a7b878d287636467&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:38:57.296859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922ca61-0422-4173-b502-59034b1e4c33 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:57.297389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922ca61-0422-4173-b502-59034b1e4c33 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:57.297389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922ca61-0422-4173-b502-59034b1e4c33 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:57.299012 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 225/456] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:57.304093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dd880-c58b-4ab7-a755-9cabf3febb20 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:57.304507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dd880-c58b-4ab7-a755-9cabf3febb20 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:57.304669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dd880-c58b-4ab7-a755-9cabf3febb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:57.324525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a73dd880-c58b-4ab7-a755-9cabf3febb20 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:57.325710 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a73dd880-c58b-4ab7-a755-9cabf3febb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:57.387076 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e6a5-498a-4404-bf94-0c51934445e2 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:57.387353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e6a5-498a-4404-bf94-0c51934445e2 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:57.387534 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e6a5-498a-4404-bf94-0c51934445e2 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:57.388868 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 226/457] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:38:57.394344 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605051-c3eb-44f1-8988-ec2a2dadc54d None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:57.394618 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605051-c3eb-44f1-8988-ec2a2dadc54d None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:57.394893 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605051-c3eb-44f1-8988-ec2a2dadc54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:57.429633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-1c605051-c3eb-44f1-8988-ec2a2dadc54d None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:57.431537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-1c605051-c3eb-44f1-8988-ec2a2dadc54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:57.433889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 232/458] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:57.544595 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 227/459] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:38:57.566214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7a1a-02c9-4385-994b-01c9b702521b None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:57.566830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7a1a-02c9-4385-994b-01c9b702521b None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:57.567355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7a1a-02c9-4385-994b-01c9b702521b None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:57.569197 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 233/460] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:57.574025 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e862c8-1749-4d10-bc91-85ad92c8e676 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:57.574319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e862c8-1749-4d10-bc91-85ad92c8e676 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:57.574599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e862c8-1749-4d10-bc91-85ad92c8e676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:57.603894 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-63e862c8-1749-4d10-bc91-85ad92c8e676 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:57.605090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-63e862c8-1749-4d10-bc91-85ad92c8e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:57.619232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:57.696346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 228/461] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:57.763523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c7a1a-02c9-4385-994b-01c9b702521b None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:57.837582 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:57.875252 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e862c8-1749-4d10-bc91-85ad92c8e676 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:57.904147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c7a1a-02c9-4385-994b-01c9b702521b None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:57.967505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00529e07-94cb-4d60-9e53-0cfe80ab4abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:57.968074 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00529e07-94cb-4d60-9e53-0cfe80ab4abb None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:57.968356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00529e07-94cb-4d60-9e53-0cfe80ab4abb None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:57.968630 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00529e07-94cb-4d60-9e53-0cfe80ab4abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:57.988180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00529e07-94cb-4d60-9e53-0cfe80ab4abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:57.989864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00529e07-94cb-4d60-9e53-0cfe80ab4abb None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-00529e07-94cb-4d60-9e53-0cfe80ab4abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:38:58.013450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:58.014551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:38:58.015472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:38:58.015472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:38:58.015472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:58.015472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 234/462] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:58.016652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00529e07-94cb-4d60-9e53-0cfe80ab4abb None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:58.052196 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e862c8-1749-4d10-bc91-85ad92c8e676 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:58.097959 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c4124-6919-4738-a147-0aabc0a46ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:58.098610 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c4124-6919-4738-a147-0aabc0a46ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.098892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c4124-6919-4738-a147-0aabc0a46ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.099198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c4124-6919-4738-a147-0aabc0a46ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.114064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c4124-6919-4738-a147-0aabc0a46ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:58.115554 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c4124-6919-4738-a147-0aabc0a46ba1 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:58.125684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-c23c4124-6919-4738-a147-0aabc0a46ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:38:58.132847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:58.133752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:38:58.134599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:38:58.134599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:38:58.134599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:58.139749 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 229/463] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:58.140613 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c4124-6919-4738-a147-0aabc0a46ba1 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:58.157448 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00529e07-94cb-4d60-9e53-0cfe80ab4abb None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:58.161707 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:58.208188 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213911d-e9e9-4e27-991d-966ed784382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:58.209331 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213911d-e9e9-4e27-991d-966ed784382b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.210051 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213911d-e9e9-4e27-991d-966ed784382b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.210497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213911d-e9e9-4e27-991d-966ed784382b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.225359 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213911d-e9e9-4e27-991d-966ed784382b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:58.226986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213911d-e9e9-4e27-991d-966ed784382b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-f213911d-e9e9-4e27-991d-966ed784382b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:38:58.244237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:58.245246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:38:58.246338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:38:58.246338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:38:58.246338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:58.251944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 235/464] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:58.253261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213911d-e9e9-4e27-991d-966ed784382b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:58.271565 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c4124-6919-4738-a147-0aabc0a46ba1 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:58.318360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4259b-50be-4596-8364-e4b659d699de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:58.319927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4259b-50be-4596-8364-e4b659d699de None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.320436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4259b-50be-4596-8364-e4b659d699de None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.321303 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4259b-50be-4596-8364-e4b659d699de None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.322401 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4259b-50be-4596-8364-e4b659d699de None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:58.322880 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4259b-50be-4596-8364-e4b659d699de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:58.325319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4259b-50be-4596-8364-e4b659d699de None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:58.346724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 230/465] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:58.346724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4259b-50be-4596-8364-e4b659d699de None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:58.377349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213911d-e9e9-4e27-991d-966ed784382b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:58.411413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36660556-2c8b-4677-8daa-4af367759210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:58.412018 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36660556-2c8b-4677-8daa-4af367759210 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.412298 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36660556-2c8b-4677-8daa-4af367759210 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.412571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36660556-2c8b-4677-8daa-4af367759210 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.413201 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36660556-2c8b-4677-8daa-4af367759210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:58.413498 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36660556-2c8b-4677-8daa-4af367759210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:58.413966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:58.414848 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36660556-2c8b-4677-8daa-4af367759210 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:58.432852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 236/466] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:58.433656 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36660556-2c8b-4677-8daa-4af367759210 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:58.453240 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:58.463816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4259b-50be-4596-8364-e4b659d699de None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:58.504711 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513acda6-82df-458b-8c84-de771fcd17b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:58.505246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513acda6-82df-458b-8c84-de771fcd17b5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.505527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513acda6-82df-458b-8c84-de771fcd17b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.505803 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513acda6-82df-458b-8c84-de771fcd17b5 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.506438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513acda6-82df-458b-8c84-de771fcd17b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:58.506738 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513acda6-82df-458b-8c84-de771fcd17b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:58.508142 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513acda6-82df-458b-8c84-de771fcd17b5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:58.524060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 231/467] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:58.524060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23fef-28be-44d3-92ac-8f1ab23b5096 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.524060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23fef-28be-44d3-92ac-8f1ab23b5096 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.524060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23fef-28be-44d3-92ac-8f1ab23b5096 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.524060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 232/468] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:58.524060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23fef-28be-44d3-92ac-8f1ab23b5096 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:58.549604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36660556-2c8b-4677-8daa-4af367759210 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:58.584231 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8ce7-ec4f-49a0-acd8-13c7df531d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:58.584845 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8ce7-ec4f-49a0-acd8-13c7df531d12 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.585129 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8ce7-ec4f-49a0-acd8-13c7df531d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.585411 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8ce7-ec4f-49a0-acd8-13c7df531d12 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.586061 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d8ce7-ec4f-49a0-acd8-13c7df531d12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:58.587529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d8ce7-ec4f-49a0-acd8-13c7df531d12 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:58.611065 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 237/469] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:58 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:58.611998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8ce7-ec4f-49a0-acd8-13c7df531d12 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:58.648706 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23fef-28be-44d3-92ac-8f1ab23b5096 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:58.677989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:58.694889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:58.703166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31610206-d5c6-487d-a2af-555e3a0a9a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:58.704175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31610206-d5c6-487d-a2af-555e3a0a9a05 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.704754 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31610206-d5c6-487d-a2af-555e3a0a9a05 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.705232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31610206-d5c6-487d-a2af-555e3a0a9a05 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.706653 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31610206-d5c6-487d-a2af-555e3a0a9a05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:58.709996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31610206-d5c6-487d-a2af-555e3a0a9a05 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:58.734329 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8ce7-ec4f-49a0-acd8-13c7df531d12 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:58.739643 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 233/470] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:58 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:58.741388 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763609-4b12-4dbe-b0a5-c8cf3273f283 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.741880 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763609-4b12-4dbe-b0a5-c8cf3273f283 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.742390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19763609-4b12-4dbe-b0a5-c8cf3273f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.768897 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-19763609-4b12-4dbe-b0a5-c8cf3273f283 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:58.770046 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-19763609-4b12-4dbe-b0a5-c8cf3273f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:58.793038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b29bf1-1498-4054-b61a-0ba183a6056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:58.794500 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b29bf1-1498-4054-b61a-0ba183a6056b None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.795113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b29bf1-1498-4054-b61a-0ba183a6056b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.796152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b29bf1-1498-4054-b61a-0ba183a6056b None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.797026 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b29bf1-1498-4054-b61a-0ba183a6056b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:58.799672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b29bf1-1498-4054-b61a-0ba183a6056b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:58.834270 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 238/471] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:58 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:38:58.883648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 234/472] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:58.953026 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20f21e-ff44-4dd5-b146-2aa1c4610f0c None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.953710 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20f21e-ff44-4dd5-b146-2aa1c4610f0c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.954188 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20f21e-ff44-4dd5-b146-2aa1c4610f0c None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.956268 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 239/473] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:38:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:38:58.962603 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e13d6-2381-4f69-9b8b-5a8fd8c8578c None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:58.962890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e13d6-2381-4f69-9b8b-5a8fd8c8578c None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:58.963204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e13d6-2381-4f69-9b8b-5a8fd8c8578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:58.984584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-ea4e13d6-2381-4f69-9b8b-5a8fd8c8578c None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:38:58.985811 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-ea4e13d6-2381-4f69-9b8b-5a8fd8c8578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:38:59.069431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 235/474] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:38:59.195118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20f21e-ff44-4dd5-b146-2aa1c4610f0c None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:59.338659 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20f21e-ff44-4dd5-b146-2aa1c4610f0c None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:59.375674 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:59.378421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e13d6-2381-4f69-9b8b-5a8fd8c8578c None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:59.385433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075ec50-337d-4341-b0bf-011d8cc9ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:59.386085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075ec50-337d-4341-b0bf-011d8cc9ef63 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:59.386408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075ec50-337d-4341-b0bf-011d8cc9ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:59.389142 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075ec50-337d-4341-b0bf-011d8cc9ef63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:59.408552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075ec50-337d-4341-b0bf-011d8cc9ef63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:59.410010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075ec50-337d-4341-b0bf-011d8cc9ef63 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-6075ec50-337d-4341-b0bf-011d8cc9ef63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:38:59.440750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:59.441733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:38:59.442577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:38:59.442577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:38:59.442577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:38:59.456239 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 240/475] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:59.461305 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:59.462757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075ec50-337d-4341-b0bf-011d8cc9ef63 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:59.548390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e13d6-2381-4f69-9b8b-5a8fd8c8578c None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:59.585058 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:59.585679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:59.585963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:59.586240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:59.586907 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:59.588598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:59.598117 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.sql.core [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 14:38:59.598117 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 03 14:38:59.598117 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [parameters: {'id': '440133d205fc4ed39cd059bc496473dd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 03 14:38:59.598117 dv-cinder-859877-2-smb devstack@keystone.service[87857]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87857) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application conn.query(q) Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application result.read() Oct 03 14:38:59.615417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return ref.to_dict() Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 14:38:59.616332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application next(self.gen) Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application yield resource Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application next(self.gen) Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise self.value Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application session.commit() Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 14:38:59.617243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.session.flush() Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application compat.raise_( Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 14:38:59.618097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:38:59.619713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application conn.query(q) Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application result.read() Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:38:59.621965 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [parameters: {'id': '440133d205fc4ed39cd059bc496473dd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:59.624471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 03 14:38:59.631227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:59.633187 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 236/476] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Oct 3 14:38:59 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:38:59.633187 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:59.692269 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075ec50-337d-4341-b0bf-011d8cc9ef63 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:59.762588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4354e-72e6-4e23-8d61-a14bbd7df180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:59.763237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4354e-72e6-4e23-8d61-a14bbd7df180 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:59.763523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4354e-72e6-4e23-8d61-a14bbd7df180 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:59.764364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4354e-72e6-4e23-8d61-a14bbd7df180 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:59.765030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4354e-72e6-4e23-8d61-a14bbd7df180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:38:59.765343 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4354e-72e6-4e23-8d61-a14bbd7df180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:38:59.766716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4354e-72e6-4e23-8d61-a14bbd7df180 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:38:59.798270 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 241/477] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:38:59.804694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4354e-72e6-4e23-8d61-a14bbd7df180 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:59.844537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2809df6-405d-4f02-aff0-c3f22508c87b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:38:59.847259 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:59.886867 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e42b9e-7c99-4318-87b1-1c0e4902bcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:38:59.887804 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42b9e-7c99-4318-87b1-1c0e4902bcb8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:38:59.888283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42b9e-7c99-4318-87b1-1c0e4902bcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:38:59.889283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e42b9e-7c99-4318-87b1-1c0e4902bcb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:38:59.890117 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:38:59.916270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e42b9e-7c99-4318-87b1-1c0e4902bcb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-34e42b9e-7c99-4318-87b1-1c0e4902bcb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:38:59.927220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:38:59.928158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 14:38:59.928954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:38:59.932324 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 237/478] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:38:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:38:59.938577 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e42b9e-7c99-4318-87b1-1c0e4902bcb8 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:38:59.990089 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4354e-72e6-4e23-8d61-a14bbd7df180 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:00.028163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce2810-be98-4cef-a615-49b1c15a67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:00.029038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce2810-be98-4cef-a615-49b1c15a67c4 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:00.030121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce2810-be98-4cef-a615-49b1c15a67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:00.030578 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce2810-be98-4cef-a615-49b1c15a67c4 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:00.031459 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce2810-be98-4cef-a615-49b1c15a67c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:00.033082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce2810-be98-4cef-a615-49b1c15a67c4 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:00.063827 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 242/479] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:38:59 2022] POST /identity/v3/users => generated 249 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:00.160989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e42b9e-7c99-4318-87b1-1c0e4902bcb8 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:00.220522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40923cb9-1312-4a26-8266-16943a33c8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:00.221403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40923cb9-1312-4a26-8266-16943a33c8a2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:00.221832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40923cb9-1312-4a26-8266-16943a33c8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:00.222272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40923cb9-1312-4a26-8266-16943a33c8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:00.223140 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40923cb9-1312-4a26-8266-16943a33c8a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:00.223599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40923cb9-1312-4a26-8266-16943a33c8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:00.225133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40923cb9-1312-4a26-8266-16943a33c8a2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:00.239206 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 238/480] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:38:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:01.428437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04231-b68a-40c5-8ee9-690f06ee9bff None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:01.429494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04231-b68a-40c5-8ee9-690f06ee9bff None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:01.430284 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04231-b68a-40c5-8ee9-690f06ee9bff None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:01.432354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 243/481] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:01.439120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efa4ba-0b90-47e6-ba70-80463b220dff None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:01.440386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efa4ba-0b90-47e6-ba70-80463b220dff None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:01.440892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efa4ba-0b90-47e6-ba70-80463b220dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:01.463879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-d6efa4ba-0b90-47e6-ba70-80463b220dff None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:01.465370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-d6efa4ba-0b90-47e6-ba70-80463b220dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:01.488646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:01.531359 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf9ad8-3a8e-47cc-9031-8a62d380004f None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:01.532019 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf9ad8-3a8e-47cc-9031-8a62d380004f None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:01.532500 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf9ad8-3a8e-47cc-9031-8a62d380004f None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:01.534303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 244/482] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:01.539255 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386fb5c-4dbc-447d-bd15-62e125143cbc None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:01.539812 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386fb5c-4dbc-447d-bd15-62e125143cbc None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:01.540152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386fb5c-4dbc-447d-bd15-62e125143cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:01.556256 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 239/483] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:01.557597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce96464-93ac-4da4-97f9-ee487399c1c9 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:01.557891 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce96464-93ac-4da4-97f9-ee487399c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:01.558165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce96464-93ac-4da4-97f9-ee487399c1c9 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:01.560038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 240/484] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:01.566085 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb0d0-3754-4bb4-9996-b552f2ff8d3b None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:01.566375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb0d0-3754-4bb4-9996-b552f2ff8d3b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:01.566652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb0d0-3754-4bb4-9996-b552f2ff8d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:01.572020 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-0386fb5c-4dbc-447d-bd15-62e125143cbc None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:01.573222 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-0386fb5c-4dbc-447d-bd15-62e125143cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:01.599994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-133cb0d0-3754-4bb4-9996-b552f2ff8d3b None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:01.601544 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-133cb0d0-3754-4bb4-9996-b552f2ff8d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:01.696202 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 241/485] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:39:01.717972 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 245/486] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:39:01.862220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb0d0-3754-4bb4-9996-b552f2ff8d3b None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:01.958902 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:01.982925 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb0d0-3754-4bb4-9996-b552f2ff8d3b None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.028503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088c28-08da-4742-a704-52e202831d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.029138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088c28-08da-4742-a704-52e202831d20 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.029473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088c28-08da-4742-a704-52e202831d20 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.029750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088c28-08da-4742-a704-52e202831d20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.038221 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386fb5c-4dbc-447d-bd15-62e125143cbc None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.044598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088c28-08da-4742-a704-52e202831d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-55088c28-08da-4742-a704-52e202831d20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:02.049871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:02.050781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:02.052168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 242/487] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:02.056538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088c28-08da-4742-a704-52e202831d20 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.106421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:02.181309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088c28-08da-4742-a704-52e202831d20 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.200469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386fb5c-4dbc-447d-bd15-62e125143cbc None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.219332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5540d0-2ffd-4255-9390-f4e84d9e123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.219861 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5540d0-2ffd-4255-9390-f4e84d9e123f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.220142 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5540d0-2ffd-4255-9390-f4e84d9e123f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.220412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5540d0-2ffd-4255-9390-f4e84d9e123f None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.221068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5540d0-2ffd-4255-9390-f4e84d9e123f None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:02.221367 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5540d0-2ffd-4255-9390-f4e84d9e123f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:02.222802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5540d0-2ffd-4255-9390-f4e84d9e123f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:02.231723 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 243/488] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:02.236989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5540d0-2ffd-4255-9390-f4e84d9e123f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.242169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:02.252612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5dc64-3619-48f6-81ac-61ff147f34cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.253794 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5dc64-3619-48f6-81ac-61ff147f34cf None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.254280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5dc64-3619-48f6-81ac-61ff147f34cf None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.254770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5dc64-3619-48f6-81ac-61ff147f34cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.275793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5dc64-3619-48f6-81ac-61ff147f34cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-9ea5dc64-3619-48f6-81ac-61ff147f34cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:02.283665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:02.284575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:02.285382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:02.293182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 246/489] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:02.293182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5dc64-3619-48f6-81ac-61ff147f34cf None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.367750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5540d0-2ffd-4255-9390-f4e84d9e123f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.396904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:02.413268 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687344c-efe8-4f99-9617-7df3e727d089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.414091 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687344c-efe8-4f99-9617-7df3e727d089 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.414317 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5dc64-3619-48f6-81ac-61ff147f34cf None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.414563 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687344c-efe8-4f99-9617-7df3e727d089 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.414987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687344c-efe8-4f99-9617-7df3e727d089 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.429927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687344c-efe8-4f99-9617-7df3e727d089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-1687344c-efe8-4f99-9617-7df3e727d089 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:02.436775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:02.437679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:02.438481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:02.443021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 244/490] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:02.445361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687344c-efe8-4f99-9617-7df3e727d089 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.462249 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48805c40-70ab-4f74-a5a0-8bbc369324f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.464625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48805c40-70ab-4f74-a5a0-8bbc369324f9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.464888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48805c40-70ab-4f74-a5a0-8bbc369324f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.465103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48805c40-70ab-4f74-a5a0-8bbc369324f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.477271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48805c40-70ab-4f74-a5a0-8bbc369324f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:02.478667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48805c40-70ab-4f74-a5a0-8bbc369324f9 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-48805c40-70ab-4f74-a5a0-8bbc369324f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:02.494523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:02.495770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:02.496610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:02.496610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:02.496610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:02.496610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 247/491] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:02.496832 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48805c40-70ab-4f74-a5a0-8bbc369324f9 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.527081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:02.570101 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687344c-efe8-4f99-9617-7df3e727d089 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.608923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f01c2-1afa-4928-8ed9-7dce9949a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.609776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f01c2-1afa-4928-8ed9-7dce9949a32a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.610271 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f01c2-1afa-4928-8ed9-7dce9949a32a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.610719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f01c2-1afa-4928-8ed9-7dce9949a32a None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.611601 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f01c2-1afa-4928-8ed9-7dce9949a32a None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:02.612140 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f01c2-1afa-4928-8ed9-7dce9949a32a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:02.613131 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48805c40-70ab-4f74-a5a0-8bbc369324f9 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.613910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f01c2-1afa-4928-8ed9-7dce9949a32a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:02.622792 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 245/492] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:02.624747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f01c2-1afa-4928-8ed9-7dce9949a32a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.656312 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2c6eb-548b-4928-b69e-60f5b5ae9e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.657330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2c6eb-548b-4928-b69e-60f5b5ae9e03 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.657694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2c6eb-548b-4928-b69e-60f5b5ae9e03 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.658042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2c6eb-548b-4928-b69e-60f5b5ae9e03 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.658807 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2c6eb-548b-4928-b69e-60f5b5ae9e03 None admin] RBAC: Adding query filter params (name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:02.659217 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2c6eb-548b-4928-b69e-60f5b5ae9e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:02.661376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2c6eb-548b-4928-b69e-60f5b5ae9e03 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:02.671056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:02.674394 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 248/493] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:02.675970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2c6eb-548b-4928-b69e-60f5b5ae9e03 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.741900 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f01c2-1afa-4928-8ed9-7dce9949a32a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.771619 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:02.783174 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc932e-820f-4e21-84d0-06326580589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.784114 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc932e-820f-4e21-84d0-06326580589f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.784540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc932e-820f-4e21-84d0-06326580589f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.785028 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc932e-820f-4e21-84d0-06326580589f None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.785899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc932e-820f-4e21-84d0-06326580589f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:02.786207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc932e-820f-4e21-84d0-06326580589f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:02.787598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc932e-820f-4e21-84d0-06326580589f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:02.801275 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 246/494] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:02.801441 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2c6eb-548b-4928-b69e-60f5b5ae9e03 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.805947 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc932e-820f-4e21-84d0-06326580589f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.850080 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba037ac-878b-4ce2-9304-4f05692e0603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.851196 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba037ac-878b-4ce2-9304-4f05692e0603 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.851485 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba037ac-878b-4ce2-9304-4f05692e0603 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.851908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba037ac-878b-4ce2-9304-4f05692e0603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.865649 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba037ac-878b-4ce2-9304-4f05692e0603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:02.867132 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba037ac-878b-4ce2-9304-4f05692e0603 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-eba037ac-878b-4ce2-9304-4f05692e0603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:02.881907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:02.882826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:02.883716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:02.883716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:02.883716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:02.887655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 249/495] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:02.889135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00b96-32e1-48e8-9707-8a8224188e8c None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.889797 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00b96-32e1-48e8-9707-8a8224188e8c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.889911 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00b96-32e1-48e8-9707-8a8224188e8c None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.891231 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 250/496] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:02.891918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a00b96-32e1-48e8-9707-8a8224188e8c None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.913626 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc932e-820f-4e21-84d0-06326580589f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:02.945721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:02.952562 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd754c-8728-4297-a14c-e64e0f03d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:02.953389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd754c-8728-4297-a14c-e64e0f03d03a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:02.953826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd754c-8728-4297-a14c-e64e0f03d03a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:02.954104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd754c-8728-4297-a14c-e64e0f03d03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:02.964059 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd754c-8728-4297-a14c-e64e0f03d03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:02.965579 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd754c-8728-4297-a14c-e64e0f03d03a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-1efd754c-8728-4297-a14c-e64e0f03d03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:02.980343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:02.981279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:02.982142 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:02.982142 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:02.982142 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:02.986773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 247/497] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:02.987659 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd754c-8728-4297-a14c-e64e0f03d03a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:02.996611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a00b96-32e1-48e8-9707-8a8224188e8c None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.031921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:03.032824 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0db8fa-d073-4b91-8c63-86094bc88274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.033468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0db8fa-d073-4b91-8c63-86094bc88274 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.033749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0db8fa-d073-4b91-8c63-86094bc88274 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.034025 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0db8fa-d073-4b91-8c63-86094bc88274 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.041790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0db8fa-d073-4b91-8c63-86094bc88274 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:03.043281 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0db8fa-d073-4b91-8c63-86094bc88274 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-ce0db8fa-d073-4b91-8c63-86094bc88274 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:03.056816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:03.058010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:03.059137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:03.062488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 251/498] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:03.063781 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6cae8-3f9d-4565-8c39-90e9212eb616 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.064068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6cae8-3f9d-4565-8c39-90e9212eb616 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.064346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6cae8-3f9d-4565-8c39-90e9212eb616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.083587 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a7b6cae8-3f9d-4565-8c39-90e9212eb616 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:03.084843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a7b6cae8-3f9d-4565-8c39-90e9212eb616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:03.109706 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd754c-8728-4297-a14c-e64e0f03d03a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.145381 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69c37-0750-492c-b16d-1054f8c35cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.146317 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69c37-0750-492c-b16d-1054f8c35cfa None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.146849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69c37-0750-492c-b16d-1054f8c35cfa None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.147386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69c37-0750-492c-b16d-1054f8c35cfa None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.148083 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb69c37-0750-492c-b16d-1054f8c35cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:03.148390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb69c37-0750-492c-b16d-1054f8c35cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:03.149759 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb69c37-0750-492c-b16d-1054f8c35cfa None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:03.170994 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 252/499] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:03.170994 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6cae8-3f9d-4565-8c39-90e9212eb616 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:03.183901 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 248/500] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:03.183901 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69c37-0750-492c-b16d-1054f8c35cfa None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:03.221173 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:03.290192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6cae8-3f9d-4565-8c39-90e9212eb616 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.291931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:03.296433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69c37-0750-492c-b16d-1054f8c35cfa None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.331464 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046314a-eede-4266-abd7-e0d1a666d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.332072 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046314a-eede-4266-abd7-e0d1a666d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.332175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30377e1-85b4-43f9-a313-493c26ad28c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.332345 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046314a-eede-4266-abd7-e0d1a666d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.332620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046314a-eede-4266-abd7-e0d1a666d5c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.332721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30377e1-85b4-43f9-a313-493c26ad28c5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.332978 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30377e1-85b4-43f9-a313-493c26ad28c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.333249 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30377e1-85b4-43f9-a313-493c26ad28c5 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.333339 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046314a-eede-4266-abd7-e0d1a666d5c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:03.333548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046314a-eede-4266-abd7-e0d1a666d5c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:03.333955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30377e1-85b4-43f9-a313-493c26ad28c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:03.334255 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30377e1-85b4-43f9-a313-493c26ad28c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:03.334905 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046314a-eede-4266-abd7-e0d1a666d5c6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:03.335684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30377e1-85b4-43f9-a313-493c26ad28c5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:03.346874 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 253/501] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:03.347697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046314a-eede-4266-abd7-e0d1a666d5c6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:03.379682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 249/502] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Oct 3 14:39:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:03.381247 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51446b73-ceb8-47e3-8512-a3f8aff7e4be None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.381727 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51446b73-ceb8-47e3-8512-a3f8aff7e4be None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.382193 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51446b73-ceb8-47e3-8512-a3f8aff7e4be None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.383847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 250/503] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:03.384754 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51446b73-ceb8-47e3-8512-a3f8aff7e4be None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:03.461388 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046314a-eede-4266-abd7-e0d1a666d5c6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.462881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:03.487132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51446b73-ceb8-47e3-8512-a3f8aff7e4be None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.497023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37acd43-fac5-4213-b804-e3032880f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.497659 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37acd43-fac5-4213-b804-e3032880f790 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.497938 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37acd43-fac5-4213-b804-e3032880f790 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.498896 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37acd43-fac5-4213-b804-e3032880f790 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.506138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37acd43-fac5-4213-b804-e3032880f790 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:03.507598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37acd43-fac5-4213-b804-e3032880f790 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c37acd43-fac5-4213-b804-e3032880f790 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:03.519189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:03.520057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:03.521543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 254/504] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:03.522114 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c6bff-d8ff-4da0-a4f7-576cc72be0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.522207 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37acd43-fac5-4213-b804-e3032880f790 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:03.522276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6bff-d8ff-4da0-a4f7-576cc72be0ff None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.522276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6bff-d8ff-4da0-a4f7-576cc72be0ff None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.522276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6bff-d8ff-4da0-a4f7-576cc72be0ff None admin] PATH_INFO: `/v3/users/glance` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.533160 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c6bff-d8ff-4da0-a4f7-576cc72be0ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:03.534601 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c6bff-d8ff-4da0-a4f7-576cc72be0ff None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-0a7c6bff-d8ff-4da0-a4f7-576cc72be0ff None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:03.547454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:03.548386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:03.549287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 251/505] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:03.549881 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac61bd-a3ce-4d5e-90cd-e2fb7998d409 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.550259 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac61bd-a3ce-4d5e-90cd-e2fb7998d409 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.550420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac61bd-a3ce-4d5e-90cd-e2fb7998d409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.567946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-caac61bd-a3ce-4d5e-90cd-e2fb7998d409 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:03.569112 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-caac61bd-a3ce-4d5e-90cd-e2fb7998d409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:03.580872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:03.625423 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37acd43-fac5-4213-b804-e3032880f790 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.636481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 252/506] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:03.637290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac61bd-a3ce-4d5e-90cd-e2fb7998d409 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:03.674842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bc061-ec23-470e-8a7e-0ec198951e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.675550 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc061-ec23-470e-8a7e-0ec198951e0a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.675835 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc061-ec23-470e-8a7e-0ec198951e0a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.676112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc061-ec23-470e-8a7e-0ec198951e0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.707983 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:03.746908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac61bd-a3ce-4d5e-90cd-e2fb7998d409 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.748649 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bc061-ec23-470e-8a7e-0ec198951e0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:03.749837 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bc061-ec23-470e-8a7e-0ec198951e0a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:03.788353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018ca7-067e-47d4-a249-37d6f57e8f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.789036 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018ca7-067e-47d4-a249-37d6f57e8f3c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.789245 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018ca7-067e-47d4-a249-37d6f57e8f3c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.789514 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018ca7-067e-47d4-a249-37d6f57e8f3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.799730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40018ca7-067e-47d4-a249-37d6f57e8f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-40018ca7-067e-47d4-a249-37d6f57e8f3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:03.804399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:03.805297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:03.806131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 253/507] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:03.806793 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018ca7-067e-47d4-a249-37d6f57e8f3c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:03.817228 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:03.859187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 255/508] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:03.860128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bc061-ec23-470e-8a7e-0ec198951e0a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:03.920975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018ca7-067e-47d4-a249-37d6f57e8f3c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.922998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:03.955278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426ed3-8e4d-4c6d-9e27-519230b76a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.955889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426ed3-8e4d-4c6d-9e27-519230b76a58 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.956166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426ed3-8e4d-4c6d-9e27-519230b76a58 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.956436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426ed3-8e4d-4c6d-9e27-519230b76a58 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.957153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426ed3-8e4d-4c6d-9e27-519230b76a58 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:03.957457 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426ed3-8e4d-4c6d-9e27-519230b76a58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:03.959191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426ed3-8e4d-4c6d-9e27-519230b76a58 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:03.961344 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bc061-ec23-470e-8a7e-0ec198951e0a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:03.976621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 254/509] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Oct 3 14:39:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:03.977418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426ed3-8e4d-4c6d-9e27-519230b76a58 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:03.995287 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91f51-94f5-4494-bbf3-bf587c9855c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:03.996152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91f51-94f5-4494-bbf3-bf587c9855c2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:03.996435 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91f51-94f5-4494-bbf3-bf587c9855c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:03.996710 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91f51-94f5-4494-bbf3-bf587c9855c2 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:03.997425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91f51-94f5-4494-bbf3-bf587c9855c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:03.997734 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91f51-94f5-4494-bbf3-bf587c9855c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:03.999212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91f51-94f5-4494-bbf3-bf587c9855c2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.034670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 256/510] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Oct 3 14:39:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:04.035520 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91f51-94f5-4494-bbf3-bf587c9855c2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.040407 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:04.077789 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426ed3-8e4d-4c6d-9e27-519230b76a58 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.111652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d12f-fe05-4255-97d3-4b61ebb73e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.112254 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d12f-fe05-4255-97d3-4b61ebb73e6e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.112530 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d12f-fe05-4255-97d3-4b61ebb73e6e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.112796 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5d12f-fe05-4255-97d3-4b61ebb73e6e None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.113437 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d12f-fe05-4255-97d3-4b61ebb73e6e None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:04.113739 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d12f-fe05-4255-97d3-4b61ebb73e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.115153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5d12f-fe05-4255-97d3-4b61ebb73e6e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.124043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 255/511] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:04.124917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d12f-fe05-4255-97d3-4b61ebb73e6e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.138398 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91f51-94f5-4494-bbf3-bf587c9855c2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.158363 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:04.173340 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de6c1a-898d-48f9-89e6-aee3f56c83b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.173970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de6c1a-898d-48f9-89e6-aee3f56c83b3 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.174254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de6c1a-898d-48f9-89e6-aee3f56c83b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.174528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de6c1a-898d-48f9-89e6-aee3f56c83b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.187297 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de6c1a-898d-48f9-89e6-aee3f56c83b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.188752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de6c1a-898d-48f9-89e6-aee3f56c83b3 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-25de6c1a-898d-48f9-89e6-aee3f56c83b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:04.203545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:04.204483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:04.205350 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:04.205350 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:04.205350 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:04.205350 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 257/512] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:04.205729 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de6c1a-898d-48f9-89e6-aee3f56c83b3 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.228096 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5d12f-fe05-4255-97d3-4b61ebb73e6e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.255108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:04.266395 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e1b50-3384-45bb-9377-c6d0134449dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.267250 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e1b50-3384-45bb-9377-c6d0134449dd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.267537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e1b50-3384-45bb-9377-c6d0134449dd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.267810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e1b50-3384-45bb-9377-c6d0134449dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.278128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e1b50-3384-45bb-9377-c6d0134449dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.279787 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e1b50-3384-45bb-9377-c6d0134449dd None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-9f9e1b50-3384-45bb-9377-c6d0134449dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:04.293800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:04.295372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:04.296331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:04.296331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:04.296331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:04.296331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 256/513] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:04.296331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e1b50-3384-45bb-9377-c6d0134449dd None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.308225 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de6c1a-898d-48f9-89e6-aee3f56c83b3 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.341751 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e43a0-ada2-4e9d-8ed8-21186ae5f30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.342386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e43a0-ada2-4e9d-8ed8-21186ae5f30a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.342733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e43a0-ada2-4e9d-8ed8-21186ae5f30a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.343039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e43a0-ada2-4e9d-8ed8-21186ae5f30a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.384966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:04.403403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e1b50-3384-45bb-9377-c6d0134449dd None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.410875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e43a0-ada2-4e9d-8ed8-21186ae5f30a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.412352 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e43a0-ada2-4e9d-8ed8-21186ae5f30a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.437287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140a3c0-bd2e-4c0f-87dd-011d14e2f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.437884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140a3c0-bd2e-4c0f-87dd-011d14e2f86c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.438158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140a3c0-bd2e-4c0f-87dd-011d14e2f86c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.438426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140a3c0-bd2e-4c0f-87dd-011d14e2f86c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.483173 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:04.505986 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140a3c0-bd2e-4c0f-87dd-011d14e2f86c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.507503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140a3c0-bd2e-4c0f-87dd-011d14e2f86c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.513490 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 258/514] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:04.514491 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e43a0-ada2-4e9d-8ed8-21186ae5f30a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.584624 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:04.612062 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 257/515] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:04.612922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140a3c0-bd2e-4c0f-87dd-011d14e2f86c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.619393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e43a0-ada2-4e9d-8ed8-21186ae5f30a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.653210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ccc71-565c-4ad5-a4aa-80237b0312aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.653839 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ccc71-565c-4ad5-a4aa-80237b0312aa None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.654120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ccc71-565c-4ad5-a4aa-80237b0312aa None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.654936 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ccc71-565c-4ad5-a4aa-80237b0312aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.664755 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ccc71-565c-4ad5-a4aa-80237b0312aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.666216 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ccc71-565c-4ad5-a4aa-80237b0312aa None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-fc3ccc71-565c-4ad5-a4aa-80237b0312aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:04.680956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:04.681876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:04.682737 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:04.682737 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:04.682737 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:04.682737 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 259/516] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:04.682984 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ccc71-565c-4ad5-a4aa-80237b0312aa None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.690405 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:04.711997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140a3c0-bd2e-4c0f-87dd-011d14e2f86c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.745752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ced5d5-c07e-45c3-a425-abe114ff9217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.746359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ced5d5-c07e-45c3-a425-abe114ff9217 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.746647 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ced5d5-c07e-45c3-a425-abe114ff9217 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.746970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ced5d5-c07e-45c3-a425-abe114ff9217 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.748484 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ced5d5-c07e-45c3-a425-abe114ff9217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:04.748484 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ced5d5-c07e-45c3-a425-abe114ff9217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.750173 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ced5d5-c07e-45c3-a425-abe114ff9217 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.761284 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 258/517] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:04.762070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ced5d5-c07e-45c3-a425-abe114ff9217 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.781660 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ccc71-565c-4ad5-a4aa-80237b0312aa None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.804661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:04.816421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d287095-7062-48a0-b9c3-b6580cd852fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.817025 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d287095-7062-48a0-b9c3-b6580cd852fd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.817302 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d287095-7062-48a0-b9c3-b6580cd852fd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.817575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d287095-7062-48a0-b9c3-b6580cd852fd None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.818195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d287095-7062-48a0-b9c3-b6580cd852fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:04.818495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d287095-7062-48a0-b9c3-b6580cd852fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.819888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d287095-7062-48a0-b9c3-b6580cd852fd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.831897 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 260/518] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:04.832747 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d287095-7062-48a0-b9c3-b6580cd852fd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.863501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ced5d5-c07e-45c3-a425-abe114ff9217 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.897317 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb3106-1ccf-4e10-b43a-b6ba8dfe0bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.897937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb3106-1ccf-4e10-b43a-b6ba8dfe0bec None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.898218 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb3106-1ccf-4e10-b43a-b6ba8dfe0bec None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.898491 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb3106-1ccf-4e10-b43a-b6ba8dfe0bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.905535 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:04.909964 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb3106-1ccf-4e10-b43a-b6ba8dfe0bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.911580 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb3106-1ccf-4e10-b43a-b6ba8dfe0bec None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-81bb3106-1ccf-4e10-b43a-b6ba8dfe0bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:04.925781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:04.926722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:04.927638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:04.927638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:04.927638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:04.927638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 259/519] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:04.927638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb3106-1ccf-4e10-b43a-b6ba8dfe0bec None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:04.937819 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d287095-7062-48a0-b9c3-b6580cd852fd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:04.972062 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3d9a4-42c8-43d1-90cc-b0062c1f0324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:04.972705 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3d9a4-42c8-43d1-90cc-b0062c1f0324 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:04.972985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3d9a4-42c8-43d1-90cc-b0062c1f0324 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:04.973254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3d9a4-42c8-43d1-90cc-b0062c1f0324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:04.983803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3d9a4-42c8-43d1-90cc-b0062c1f0324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:04.985258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3d9a4-42c8-43d1-90cc-b0062c1f0324 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-6ab3d9a4-42c8-43d1-90cc-b0062c1f0324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:05.000643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:05.001745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:05.002982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:05.002982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:05.002982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:05.002982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 261/520] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:05.002982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3d9a4-42c8-43d1-90cc-b0062c1f0324 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.031456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb3106-1ccf-4e10-b43a-b6ba8dfe0bec None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.038678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:05.064844 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c18f6-bfc0-4917-9c28-a89c70052007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.065449 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c18f6-bfc0-4917-9c28-a89c70052007 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.065732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c18f6-bfc0-4917-9c28-a89c70052007 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.066006 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c18f6-bfc0-4917-9c28-a89c70052007 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.066639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c18f6-bfc0-4917-9c28-a89c70052007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:05.066970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c18f6-bfc0-4917-9c28-a89c70052007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.068343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c18f6-bfc0-4917-9c28-a89c70052007 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.081259 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 260/521] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:05.082036 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c18f6-bfc0-4917-9c28-a89c70052007 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.109967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3d9a4-42c8-43d1-90cc-b0062c1f0324 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.134206 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:05.143664 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec353f0-ad2f-41ab-8e4a-ef5f4dc0341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.144300 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec353f0-ad2f-41ab-8e4a-ef5f4dc0341a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.144582 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec353f0-ad2f-41ab-8e4a-ef5f4dc0341a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.144858 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec353f0-ad2f-41ab-8e4a-ef5f4dc0341a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.151353 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec353f0-ad2f-41ab-8e4a-ef5f4dc0341a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.152802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec353f0-ad2f-41ab-8e4a-ef5f4dc0341a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-4ec353f0-ad2f-41ab-8e4a-ef5f4dc0341a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:05.164456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:05.165444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:05.166275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:05.166275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:05.166275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:05.166275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:05.166275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:05.166275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:05.166275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:05.166275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:05.166275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 262/522] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:05.166783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec353f0-ad2f-41ab-8e4a-ef5f4dc0341a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.189652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c18f6-bfc0-4917-9c28-a89c70052007 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.224047 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ca7de-50a8-40bd-a2d7-cc7b31fa2649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.224653 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ca7de-50a8-40bd-a2d7-cc7b31fa2649 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.224932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ca7de-50a8-40bd-a2d7-cc7b31fa2649 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.225204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ca7de-50a8-40bd-a2d7-cc7b31fa2649 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.225868 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ca7de-50a8-40bd-a2d7-cc7b31fa2649 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.227332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ca7de-50a8-40bd-a2d7-cc7b31fa2649 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.249087 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 261/523] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:39:05 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:05.249899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ca7de-50a8-40bd-a2d7-cc7b31fa2649 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.284015 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:05.290836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec353f0-ad2f-41ab-8e4a-ef5f4dc0341a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.335295 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314fb0-faf2-41f8-81d8-902ff51ab51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.335930 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314fb0-faf2-41f8-81d8-902ff51ab51c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.336212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314fb0-faf2-41f8-81d8-902ff51ab51c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.336484 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314fb0-faf2-41f8-81d8-902ff51ab51c None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.337527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314fb0-faf2-41f8-81d8-902ff51ab51c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:05.337832 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314fb0-faf2-41f8-81d8-902ff51ab51c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.339894 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314fb0-faf2-41f8-81d8-902ff51ab51c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.356240 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 263/524] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:05.357113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314fb0-faf2-41f8-81d8-902ff51ab51c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.368256 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ca7de-50a8-40bd-a2d7-cc7b31fa2649 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.378299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:05.412837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37ed45-e1d3-4e3b-9285-d57742f250db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.413366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ed45-e1d3-4e3b-9285-d57742f250db None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.413652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ed45-e1d3-4e3b-9285-d57742f250db None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.413930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ed45-e1d3-4e3b-9285-d57742f250db None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.414580 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37ed45-e1d3-4e3b-9285-d57742f250db None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:05.415031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37ed45-e1d3-4e3b-9285-d57742f250db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.416408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37ed45-e1d3-4e3b-9285-d57742f250db None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.429010 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 262/525] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:05.429839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37ed45-e1d3-4e3b-9285-d57742f250db None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.475902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314fb0-faf2-41f8-81d8-902ff51ab51c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.513204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60898bf2-2347-4ab3-be64-2c7e689cee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.513940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60898bf2-2347-4ab3-be64-2c7e689cee01 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.514471 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60898bf2-2347-4ab3-be64-2c7e689cee01 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.514471 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60898bf2-2347-4ab3-be64-2c7e689cee01 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.521953 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60898bf2-2347-4ab3-be64-2c7e689cee01 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.523491 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60898bf2-2347-4ab3-be64-2c7e689cee01 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-60898bf2-2347-4ab3-be64-2c7e689cee01 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:05.536332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:05.537264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 264/526] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:05.538178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60898bf2-2347-4ab3-be64-2c7e689cee01 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.547421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37ed45-e1d3-4e3b-9285-d57742f250db None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.558362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:05.585062 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e96e5-a8c2-463c-8ffe-ec6c4b75a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.585702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e96e5-a8c2-463c-8ffe-ec6c4b75a46b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.586269 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e96e5-a8c2-463c-8ffe-ec6c4b75a46b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.586631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e96e5-a8c2-463c-8ffe-ec6c4b75a46b None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.587262 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e96e5-a8c2-463c-8ffe-ec6c4b75a46b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:05.587569 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e96e5-a8c2-463c-8ffe-ec6c4b75a46b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.588976 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e96e5-a8c2-463c-8ffe-ec6c4b75a46b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.612874 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 263/527] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:05.612874 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e96e5-a8c2-463c-8ffe-ec6c4b75a46b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.643696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:05.652634 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60898bf2-2347-4ab3-be64-2c7e689cee01 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.687399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad289f27-45be-44d4-b7d5-00494edf5d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.688100 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad289f27-45be-44d4-b7d5-00494edf5d3f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.688384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad289f27-45be-44d4-b7d5-00494edf5d3f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.688660 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad289f27-45be-44d4-b7d5-00494edf5d3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.695824 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad289f27-45be-44d4-b7d5-00494edf5d3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.697266 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad289f27-45be-44d4-b7d5-00494edf5d3f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-ad289f27-45be-44d4-b7d5-00494edf5d3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:05.709512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:05.710529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:05.711592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:05.711592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:05.711592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:05.711592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:05.711592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:05.711592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:05.711592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:05.711592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:05.715425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 265/528] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:05.716038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad289f27-45be-44d4-b7d5-00494edf5d3f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.727187 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e96e5-a8c2-463c-8ffe-ec6c4b75a46b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.774990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441fe29-49a1-4c1d-a7f3-c202aad75c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.774990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441fe29-49a1-4c1d-a7f3-c202aad75c8c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.774990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441fe29-49a1-4c1d-a7f3-c202aad75c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.774990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441fe29-49a1-4c1d-a7f3-c202aad75c8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.780753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441fe29-49a1-4c1d-a7f3-c202aad75c8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.782314 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441fe29-49a1-4c1d-a7f3-c202aad75c8c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-1441fe29-49a1-4c1d-a7f3-c202aad75c8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:05.795781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:05.796646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:05.797537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:05.797537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:05.797537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:05.797537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:05.797537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:05.797537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:05.797537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:05.797537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:05.797537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 264/529] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:05.799097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441fe29-49a1-4c1d-a7f3-c202aad75c8c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.803716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:05.829564 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad289f27-45be-44d4-b7d5-00494edf5d3f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.864584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94d84a-dbbc-493c-96f6-f57ef03afd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.865254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94d84a-dbbc-493c-96f6-f57ef03afd54 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.865565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94d84a-dbbc-493c-96f6-f57ef03afd54 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.865811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94d84a-dbbc-493c-96f6-f57ef03afd54 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.866539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94d84a-dbbc-493c-96f6-f57ef03afd54 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:05.866844 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94d84a-dbbc-493c-96f6-f57ef03afd54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.868311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94d84a-dbbc-493c-96f6-f57ef03afd54 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.892216 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:05.892389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 266/530] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:05.893587 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94d84a-dbbc-493c-96f6-f57ef03afd54 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:05.909328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441fe29-49a1-4c1d-a7f3-c202aad75c8c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:05.945429 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08e432-c06d-49c7-b24c-90d601ab9b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:05.945961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08e432-c06d-49c7-b24c-90d601ab9b59 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:05.946248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08e432-c06d-49c7-b24c-90d601ab9b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:05.946527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08e432-c06d-49c7-b24c-90d601ab9b59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:05.947356 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08e432-c06d-49c7-b24c-90d601ab9b59 None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=bfb0254e89514ff18e1c91dc427e4b1e) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:05.947670 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08e432-c06d-49c7-b24c-90d601ab9b59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:05.949094 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08e432-c06d-49c7-b24c-90d601ab9b59 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:05.955953 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 265/531] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/role_assignments?user.id=bfb0254e89514ff18e1c91dc427e4b1e&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:05.956637 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08e432-c06d-49c7-b24c-90d601ab9b59 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:06.021363 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94d84a-dbbc-493c-96f6-f57ef03afd54 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:06.066202 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758cf5b-ef08-4468-a7a6-ac7d08c8d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:06.067354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758cf5b-ef08-4468-a7a6-ac7d08c8d00d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:06.067929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758cf5b-ef08-4468-a7a6-ac7d08c8d00d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:06.068395 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758cf5b-ef08-4468-a7a6-ac7d08c8d00d None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:06.069305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758cf5b-ef08-4468-a7a6-ac7d08c8d00d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:06.069809 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758cf5b-ef08-4468-a7a6-ac7d08c8d00d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:06.071712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758cf5b-ef08-4468-a7a6-ac7d08c8d00d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:06.073841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:06.088510 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08e432-c06d-49c7-b24c-90d601ab9b59 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:06.102549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 267/532] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:06.103980 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758cf5b-ef08-4468-a7a6-ac7d08c8d00d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:06.128495 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d07e2-790c-45ee-aeae-30e5ed51e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:06.129121 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d07e2-790c-45ee-aeae-30e5ed51e686 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:06.129407 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d07e2-790c-45ee-aeae-30e5ed51e686 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:06.129687 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d07e2-790c-45ee-aeae-30e5ed51e686 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:06.130391 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d07e2-790c-45ee-aeae-30e5ed51e686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:06.130703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d07e2-790c-45ee-aeae-30e5ed51e686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:06.132199 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d07e2-790c-45ee-aeae-30e5ed51e686 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:06.151041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 266/533] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:06.151041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d07e2-790c-45ee-aeae-30e5ed51e686 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:06.160876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:06.224653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758cf5b-ef08-4468-a7a6-ac7d08c8d00d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:06.261789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a3d0-ddb5-49e7-9e46-986f06021147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:06.262766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a3d0-ddb5-49e7-9e46-986f06021147 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:06.263051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d07e2-790c-45ee-aeae-30e5ed51e686 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:06.263524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a3d0-ddb5-49e7-9e46-986f06021147 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:06.264018 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0a3d0-ddb5-49e7-9e46-986f06021147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:06.307628 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afc803-477d-4ffa-8a97-473e22f51621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:06.308242 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afc803-477d-4ffa-8a97-473e22f51621 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:06.308525 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afc803-477d-4ffa-8a97-473e22f51621 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:06.308799 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afc803-477d-4ffa-8a97-473e22f51621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:06.309519 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afc803-477d-4ffa-8a97-473e22f51621 None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=986544a87d444d57a9f6b2018f11967d) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:06.309830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afc803-477d-4ffa-8a97-473e22f51621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:06.312147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afc803-477d-4ffa-8a97-473e22f51621 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:06.326993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 267/534] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:06 2022] GET /identity/v3/role_assignments?user.id=986544a87d444d57a9f6b2018f11967d&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:06.326993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afc803-477d-4ffa-8a97-473e22f51621 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:06.349718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:06.365473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0a3d0-ddb5-49e7-9e46-986f06021147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:06.367425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0a3d0-ddb5-49e7-9e46-986f06021147 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:06.415855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:06.455000 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afc803-477d-4ffa-8a97-473e22f51621 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:06.497292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6305648-30ab-4baf-b3be-5e1ef9c5880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:06.497949 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6305648-30ab-4baf-b3be-5e1ef9c5880a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:06.498795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6305648-30ab-4baf-b3be-5e1ef9c5880a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:06.499139 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6305648-30ab-4baf-b3be-5e1ef9c5880a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:06.500131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6305648-30ab-4baf-b3be-5e1ef9c5880a None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=f43a588d7ac34be7a8c2140a42e10dc0) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:06.500451 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6305648-30ab-4baf-b3be-5e1ef9c5880a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:06.502035 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6305648-30ab-4baf-b3be-5e1ef9c5880a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:06.505406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 268/535] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:06.510993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 268/536] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:06 2022] GET /identity/v3/role_assignments?user.id=f43a588d7ac34be7a8c2140a42e10dc0&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:06.512216 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a3d0-ddb5-49e7-9e46-986f06021147 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:06.641603 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:06.648667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0a3d0-ddb5-49e7-9e46-986f06021147 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:06.686452 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027479e-6e16-4a98-8df3-ab92f069c5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:06.687142 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027479e-6e16-4a98-8df3-ab92f069c5cf None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:06.687421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027479e-6e16-4a98-8df3-ab92f069c5cf None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:06.687691 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027479e-6e16-4a98-8df3-ab92f069c5cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:06.698986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027479e-6e16-4a98-8df3-ab92f069c5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:06.700466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027479e-6e16-4a98-8df3-ab92f069c5cf None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c027479e-6e16-4a98-8df3-ab92f069c5cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:06.716947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:06.718605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:06.719612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:06.719612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:06.719612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:06.719612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 269/537] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:06.723942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6305648-30ab-4baf-b3be-5e1ef9c5880a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:06.835560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6305648-30ab-4baf-b3be-5e1ef9c5880a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:06.880064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed784-031e-4e69-9722-75c8519b7bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:06.880727 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed784-031e-4e69-9722-75c8519b7bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:06.881008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed784-031e-4e69-9722-75c8519b7bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:06.881278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed784-031e-4e69-9722-75c8519b7bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:06.881918 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ed784-031e-4e69-9722-75c8519b7bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:06.882204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ed784-031e-4e69-9722-75c8519b7bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:06.883645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ed784-031e-4e69-9722-75c8519b7bc8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:06.896583 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:06.906750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 269/538] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:06.912029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027479e-6e16-4a98-8df3-ab92f069c5cf None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:07.048267 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027479e-6e16-4a98-8df3-ab92f069c5cf None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:07.092269 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6db99-cde7-4262-88f9-f42b8f759d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:07.093029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6db99-cde7-4262-88f9-f42b8f759d3f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:07.093274 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6db99-cde7-4262-88f9-f42b8f759d3f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:07.093547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6db99-cde7-4262-88f9-f42b8f759d3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:07.110530 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6db99-cde7-4262-88f9-f42b8f759d3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:07.112014 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6db99-cde7-4262-88f9-f42b8f759d3f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-1db6db99-cde7-4262-88f9-f42b8f759d3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:07.130572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:07.131506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:07.132371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:07.132371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:07.132371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:07.132371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:07.132371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:07.132371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:07.132371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:07.132371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:07.132371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 270/539] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:07.137878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed784-031e-4e69-9722-75c8519b7bc8 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:07.274112 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed784-031e-4e69-9722-75c8519b7bc8 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:07.311408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed5e14-d299-4d20-bc17-189bdb7bddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:07.311963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5e14-d299-4d20-bc17-189bdb7bddd8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:07.312242 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5e14-d299-4d20-bc17-189bdb7bddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:07.312511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed5e14-d299-4d20-bc17-189bdb7bddd8 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:07.313220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed5e14-d299-4d20-bc17-189bdb7bddd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:07.313525 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed5e14-d299-4d20-bc17-189bdb7bddd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:07.315010 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed5e14-d299-4d20-bc17-189bdb7bddd8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:07.332750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 270/540] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:07.338546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6db99-cde7-4262-88f9-f42b8f759d3f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:07.348589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:07.481297 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6db99-cde7-4262-88f9-f42b8f759d3f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:07.506412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531bee-9db5-4abb-ab1c-52c6a8b5db5e None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:07.506718 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531bee-9db5-4abb-ab1c-52c6a8b5db5e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:07.506971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531bee-9db5-4abb-ab1c-52c6a8b5db5e None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:07.508345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 271/541] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:07.521585 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e38573-8239-4c44-b7b6-274cdbf8bfde None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:07.521865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e38573-8239-4c44-b7b6-274cdbf8bfde None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:07.522137 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e38573-8239-4c44-b7b6-274cdbf8bfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:07.525277 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb077902-b395-4af0-ad64-8ab0c0f0b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:07.525887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb077902-b395-4af0-ad64-8ab0c0f0b131 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:07.526204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb077902-b395-4af0-ad64-8ab0c0f0b131 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:07.526427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb077902-b395-4af0-ad64-8ab0c0f0b131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:07.527175 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb077902-b395-4af0-ad64-8ab0c0f0b131 None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=0561a97f1a4d4f469cb5c2103e2541f3) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:07.527483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb077902-b395-4af0-ad64-8ab0c0f0b131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:07.528898 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb077902-b395-4af0-ad64-8ab0c0f0b131 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:07.536453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 271/542] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:07 2022] GET /identity/v3/role_assignments?user.id=0561a97f1a4d4f469cb5c2103e2541f3&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:07.560129 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-55e38573-8239-4c44-b7b6-274cdbf8bfde None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:07.563430 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-55e38573-8239-4c44-b7b6-274cdbf8bfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:07.661970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:07.682473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 272/543] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 03 14:39:08.001187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb077902-b395-4af0-ad64-8ab0c0f0b131 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:08.107128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:08.149681 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb077902-b395-4af0-ad64-8ab0c0f0b131 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:08.197594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f9765-5ea0-4a5b-be62-dd699380edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:08.198231 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f9765-5ea0-4a5b-be62-dd699380edab None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:08.198514 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f9765-5ea0-4a5b-be62-dd699380edab None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:08.198786 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f9765-5ea0-4a5b-be62-dd699380edab None admin] PATH_INFO: `/v3/roles/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:08.213386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f9765-5ea0-4a5b-be62-dd699380edab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c03f9765-5ea0-4a5b-be62-dd699380edab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:08.219852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:08.220768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:08.221553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 272/544] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:08.228587 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e38573-8239-4c44-b7b6-274cdbf8bfde None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:08.364694 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e38573-8239-4c44-b7b6-274cdbf8bfde None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:08.433083 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f536eca-038a-4318-85c5-2ed10897cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:08.434081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f536eca-038a-4318-85c5-2ed10897cddb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:08.434632 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f536eca-038a-4318-85c5-2ed10897cddb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:08.435155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f536eca-038a-4318-85c5-2ed10897cddb None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:08.436557 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f536eca-038a-4318-85c5-2ed10897cddb None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:08.437087 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f536eca-038a-4318-85c5-2ed10897cddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:08.438722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f536eca-038a-4318-85c5-2ed10897cddb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:08.458342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 273/545] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:08.464329 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f9765-5ea0-4a5b-be62-dd699380edab None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:08.671569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f9765-5ea0-4a5b-be62-dd699380edab None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:08.734808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:08.744745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312c43b-6166-4b67-8f9a-03f2945e73ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:08.745663 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312c43b-6166-4b67-8f9a-03f2945e73ab None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:08.745946 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312c43b-6166-4b67-8f9a-03f2945e73ab None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:08.746214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312c43b-6166-4b67-8f9a-03f2945e73ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:08.773416 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312c43b-6166-4b67-8f9a-03f2945e73ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:08.774899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312c43b-6166-4b67-8f9a-03f2945e73ab None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-7312c43b-6166-4b67-8f9a-03f2945e73ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:08.800364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:08.801310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:08.802152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:08.802152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:08.802152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:08.802152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 273/546] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:08.808586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f536eca-038a-4318-85c5-2ed10897cddb None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:08.889238 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:08.976942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f536eca-038a-4318-85c5-2ed10897cddb None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:09.049802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe598f-8f35-4bdf-a0f6-ec2f335f3613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:09.050791 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe598f-8f35-4bdf-a0f6-ec2f335f3613 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.051316 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe598f-8f35-4bdf-a0f6-ec2f335f3613 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.051814 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe598f-8f35-4bdf-a0f6-ec2f335f3613 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.052676 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe598f-8f35-4bdf-a0f6-ec2f335f3613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:09.053189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe598f-8f35-4bdf-a0f6-ec2f335f3613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:09.054781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe598f-8f35-4bdf-a0f6-ec2f335f3613 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:09.082392 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 274/547] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:09.088410 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312c43b-6166-4b67-8f9a-03f2945e73ab None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:09.172399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0198f-cccc-4f4b-8c2b-79d83450546a None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.173030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0198f-cccc-4f4b-8c2b-79d83450546a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.173506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0198f-cccc-4f4b-8c2b-79d83450546a None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.175314 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 275/548] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:09.180215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0d726-56d9-427c-8542-7041face30c4 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.180492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0d726-56d9-427c-8542-7041face30c4 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.180758 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0d726-56d9-427c-8542-7041face30c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.213926 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-1db0d726-56d9-427c-8542-7041face30c4 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:09.215219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-1db0d726-56d9-427c-8542-7041face30c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:09.254599 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312c43b-6166-4b67-8f9a-03f2945e73ab None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:09.293113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20784a28-604c-4efd-940c-885af8481195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:09.293780 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20784a28-604c-4efd-940c-885af8481195 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.294040 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20784a28-604c-4efd-940c-885af8481195 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.294312 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20784a28-604c-4efd-940c-885af8481195 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.297391 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 276/549] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:09.299418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e622a-1ff2-49a4-8480-aa174cddbe9f None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.299854 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e622a-1ff2-49a4-8480-aa174cddbe9f None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.300290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e622a-1ff2-49a4-8480-aa174cddbe9f None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.302238 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 277/550] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:09.308335 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab81396-1a5c-4a68-9217-baad8ebde123 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.308798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab81396-1a5c-4a68-9217-baad8ebde123 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.309142 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20784a28-604c-4efd-940c-885af8481195 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:09.309371 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab81396-1a5c-4a68-9217-baad8ebde123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.311348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20784a28-604c-4efd-940c-885af8481195 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:09.331168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-aab81396-1a5c-4a68-9217-baad8ebde123 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:09.332730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-aab81396-1a5c-4a68-9217-baad8ebde123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-20784a28-604c-4efd-940c-885af8481195 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:09.338084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:09.343675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:09.344843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 274/551] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:09.345721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20784a28-604c-4efd-940c-885af8481195 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:09.405089 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:09.409511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:09.457095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 278/552] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:09.458411 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c3987-43c0-47d1-85cc-52755d8727da None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.458695 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c3987-43c0-47d1-85cc-52755d8727da None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.458986 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c3987-43c0-47d1-85cc-52755d8727da None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.460758 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 279/553] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:09.472355 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42053-2c6d-4aad-ae6a-6d15cabbe8d4 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.472638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42053-2c6d-4aad-ae6a-6d15cabbe8d4 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.473048 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42053-2c6d-4aad-ae6a-6d15cabbe8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.488056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20784a28-604c-4efd-940c-885af8481195 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:09.510374 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-19e42053-2c6d-4aad-ae6a-6d15cabbe8d4 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:09.512762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-19e42053-2c6d-4aad-ae6a-6d15cabbe8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:09.553468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da7fb-2476-4ced-b107-e75a094d26ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:09.554339 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da7fb-2476-4ced-b107-e75a094d26ad None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.555001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da7fb-2476-4ced-b107-e75a094d26ad None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.555596 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252da7fb-2476-4ced-b107-e75a094d26ad None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.557497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252da7fb-2476-4ced-b107-e75a094d26ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:09.557965 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252da7fb-2476-4ced-b107-e75a094d26ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:09.560413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252da7fb-2476-4ced-b107-e75a094d26ad None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:09.597336 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 275/554] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Oct 3 14:39:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:09.598938 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da7fb-2476-4ced-b107-e75a094d26ad None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:09.634924 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 280/555] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:09.636241 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e42053-2c6d-4aad-ae6a-6d15cabbe8d4 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:09.759634 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:09.764932 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252da7fb-2476-4ced-b107-e75a094d26ad None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:09.812331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:09.815974 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e42053-2c6d-4aad-ae6a-6d15cabbe8d4 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:09.819126 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a178-addd-409f-b034-6ba9e1f532ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:09.819741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a178-addd-409f-b034-6ba9e1f532ad None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.820019 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a178-addd-409f-b034-6ba9e1f532ad None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.820289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836a178-addd-409f-b034-6ba9e1f532ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.854334 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1492112-24ee-4590-a04f-b236478a8817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:09.855000 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1492112-24ee-4590-a04f-b236478a8817 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:09.855291 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1492112-24ee-4590-a04f-b236478a8817 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:09.855565 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1492112-24ee-4590-a04f-b236478a8817 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:09.867540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1492112-24ee-4590-a04f-b236478a8817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-e1492112-24ee-4590-a04f-b236478a8817 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:09.874359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:09.875319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 281/556] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:09.876712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1492112-24ee-4590-a04f-b236478a8817 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:09.897099 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a178-addd-409f-b034-6ba9e1f532ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:09.898650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836a178-addd-409f-b034-6ba9e1f532ad None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:09.986234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1492112-24ee-4590-a04f-b236478a8817 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.002237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:10.011641 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 276/557] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 14:39:10.012589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a178-addd-409f-b034-6ba9e1f532ad None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.027587 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c59cc0-812b-4d72-9b05-9b311e51cc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.028146 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c59cc0-812b-4d72-9b05-9b311e51cc29 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.028428 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c59cc0-812b-4d72-9b05-9b311e51cc29 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.028700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c59cc0-812b-4d72-9b05-9b311e51cc29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.040591 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c59cc0-812b-4d72-9b05-9b311e51cc29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-b6c59cc0-812b-4d72-9b05-9b311e51cc29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:10.046766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:10.047703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:10.048522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 282/558] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:10.049203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c59cc0-812b-4d72-9b05-9b311e51cc29 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.073738 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:10.125641 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836a178-addd-409f-b034-6ba9e1f532ad None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.161441 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308da836-84a7-457b-8ce5-bb45cc06b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.162071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da836-84a7-457b-8ce5-bb45cc06b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.162354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da836-84a7-457b-8ce5-bb45cc06b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.162854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da836-84a7-457b-8ce5-bb45cc06b7a7 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.163323 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308da836-84a7-457b-8ce5-bb45cc06b7a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:10.163624 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308da836-84a7-457b-8ce5-bb45cc06b7a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:10.165041 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308da836-84a7-457b-8ce5-bb45cc06b7a7 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:10.167229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c59cc0-812b-4d72-9b05-9b311e51cc29 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.179463 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 277/559] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:10.179463 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308da836-84a7-457b-8ce5-bb45cc06b7a7 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.212880 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a80d6-c3eb-44a5-9af2-fb005558b1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.213618 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a80d6-c3eb-44a5-9af2-fb005558b1ff None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.213961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a80d6-c3eb-44a5-9af2-fb005558b1ff None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.214300 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a80d6-c3eb-44a5-9af2-fb005558b1ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.225603 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a80d6-c3eb-44a5-9af2-fb005558b1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-559a80d6-c3eb-44a5-9af2-fb005558b1ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:10.230390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:10.231532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 283/560] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:10.236424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a80d6-c3eb-44a5-9af2-fb005558b1ff None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.257083 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:10.304052 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308da836-84a7-457b-8ce5-bb45cc06b7a7 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.320694 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:10.338166 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4127338-7b75-4e14-96fb-d3a5fafdf0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.338787 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4127338-7b75-4e14-96fb-d3a5fafdf0d0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.339098 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4127338-7b75-4e14-96fb-d3a5fafdf0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.339372 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4127338-7b75-4e14-96fb-d3a5fafdf0d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.340433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a80d6-c3eb-44a5-9af2-fb005558b1ff None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.349862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4127338-7b75-4e14-96fb-d3a5fafdf0d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:10.351310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4127338-7b75-4e14-96fb-d3a5fafdf0d0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-d4127338-7b75-4e14-96fb-d3a5fafdf0d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:10.365750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:10.366886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:10.368022 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:10.368022 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:10.368022 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:10.368022 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 278/561] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:10.368022 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4127338-7b75-4e14-96fb-d3a5fafdf0d0 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.378150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190912-6a76-481c-8344-eff0f0840a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.378757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190912-6a76-481c-8344-eff0f0840a14 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.379068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190912-6a76-481c-8344-eff0f0840a14 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.379346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0190912-6a76-481c-8344-eff0f0840a14 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.380005 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0190912-6a76-481c-8344-eff0f0840a14 None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:10.380310 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0190912-6a76-481c-8344-eff0f0840a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:10.381668 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0190912-6a76-481c-8344-eff0f0840a14 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:10.390133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 284/562] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:10.390907 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190912-6a76-481c-8344-eff0f0840a14 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.471807 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4127338-7b75-4e14-96fb-d3a5fafdf0d0 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.486487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:10.500293 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0190912-6a76-481c-8344-eff0f0840a14 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.509001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a2f5b-8a7a-42fa-a741-6166cdb43002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.509635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2f5b-8a7a-42fa-a741-6166cdb43002 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.509916 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2f5b-8a7a-42fa-a741-6166cdb43002 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.510195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a2f5b-8a7a-42fa-a741-6166cdb43002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.520804 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a2f5b-8a7a-42fa-a741-6166cdb43002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:10.522251 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a2f5b-8a7a-42fa-a741-6166cdb43002 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:10.532334 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94cea-939b-43d3-ba42-390aa70c7e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.532931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94cea-939b-43d3-ba42-390aa70c7e66 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.533208 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94cea-939b-43d3-ba42-390aa70c7e66 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.533476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed94cea-939b-43d3-ba42-390aa70c7e66 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.534683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94cea-939b-43d3-ba42-390aa70c7e66 None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:10.535008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94cea-939b-43d3-ba42-390aa70c7e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:10.536342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed94cea-939b-43d3-ba42-390aa70c7e66 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c26a2f5b-8a7a-42fa-a741-6166cdb43002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:10.536437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:10.537503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:10.538873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:10.538873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:10.538873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:10.538873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 279/563] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:10.539146 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11235c-ab9b-4a71-a453-d5f13076a4fc None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.539628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11235c-ab9b-4a71-a453-d5f13076a4fc None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.539628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11235c-ab9b-4a71-a453-d5f13076a4fc None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.540874 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 280/564] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:10.543742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11235c-ab9b-4a71-a453-d5f13076a4fc None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.546055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 285/565] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:10.546842 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94cea-939b-43d3-ba42-390aa70c7e66 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.550711 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:10.646957 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed94cea-939b-43d3-ba42-390aa70c7e66 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.647793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11235c-ab9b-4a71-a453-d5f13076a4fc None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.678604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4c7b3-93f3-4e24-a016-0fd06f44eafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.679258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4c7b3-93f3-4e24-a016-0fd06f44eafb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.679541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4c7b3-93f3-4e24-a016-0fd06f44eafb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.679815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4c7b3-93f3-4e24-a016-0fd06f44eafb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.679956 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009a9c7-2165-452f-904e-944c2c5044b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.680560 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009a9c7-2165-452f-904e-944c2c5044b1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.680843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009a9c7-2165-452f-904e-944c2c5044b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.681122 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009a9c7-2165-452f-904e-944c2c5044b1 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.681761 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009a9c7-2165-452f-904e-944c2c5044b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:10.682064 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009a9c7-2165-452f-904e-944c2c5044b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:10.683479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009a9c7-2165-452f-904e-944c2c5044b1 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:10.690771 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4c7b3-93f3-4e24-a016-0fd06f44eafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:10.692204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4c7b3-93f3-4e24-a016-0fd06f44eafb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:10.695087 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 281/566] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:10.695871 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009a9c7-2165-452f-904e-944c2c5044b1 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-7cd4c7b3-93f3-4e24-a016-0fd06f44eafb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:10.708408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:10.709448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:10.710340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:10.710340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:10.710340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:10.710340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 286/567] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:10.710999 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded743b-a98e-4013-b9c4-ee8bdc457e50 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.711111 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded743b-a98e-4013-b9c4-ee8bdc457e50 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.711306 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded743b-a98e-4013-b9c4-ee8bdc457e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.725064 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:10.728498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-2ded743b-a98e-4013-b9c4-ee8bdc457e50 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:10.729656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-2ded743b-a98e-4013-b9c4-ee8bdc457e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:10.780309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:10.797267 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 287/568] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:10.797405 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009a9c7-2165-452f-904e-944c2c5044b1 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.798085 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded743b-a98e-4013-b9c4-ee8bdc457e50 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.838558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29419fa-5516-41f8-909b-6da688fc6528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.839471 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29419fa-5516-41f8-909b-6da688fc6528 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.840405 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29419fa-5516-41f8-909b-6da688fc6528 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.840860 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29419fa-5516-41f8-909b-6da688fc6528 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.842657 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29419fa-5516-41f8-909b-6da688fc6528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:10.843248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29419fa-5516-41f8-909b-6da688fc6528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:10.845456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29419fa-5516-41f8-909b-6da688fc6528 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:10.861557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 282/569] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:10.863282 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29419fa-5516-41f8-909b-6da688fc6528 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:10.903854 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded743b-a98e-4013-b9c4-ee8bdc457e50 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.940221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733a2b-f8fa-406a-a486-948878c7490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:10.940851 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733a2b-f8fa-406a-a486-948878c7490c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:10.941128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733a2b-f8fa-406a-a486-948878c7490c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:10.941398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733a2b-f8fa-406a-a486-948878c7490c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:10.953630 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f733a2b-f8fa-406a-a486-948878c7490c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:10.955105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f733a2b-f8fa-406a-a486-948878c7490c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:10.958264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-3f733a2b-f8fa-406a-a486-948878c7490c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:10.970875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:10.972043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:10.973067 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:10.973067 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:10.973067 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:10.974989 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29419fa-5516-41f8-909b-6da688fc6528 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:10.978975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 288/570] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:10.979868 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733a2b-f8fa-406a-a486-948878c7490c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.010492 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc521be-6bca-49e8-95e1-212bfd1b4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.011303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc521be-6bca-49e8-95e1-212bfd1b4971 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.011583 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc521be-6bca-49e8-95e1-212bfd1b4971 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.011854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc521be-6bca-49e8-95e1-212bfd1b4971 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.019810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc521be-6bca-49e8-95e1-212bfd1b4971 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.021283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc521be-6bca-49e8-95e1-212bfd1b4971 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.026490 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-1bc521be-6bca-49e8-95e1-212bfd1b4971 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:11.034811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:11.035810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:11.036712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:11.036712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:11.036712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:11.036712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:11.036712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:11.036712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:11.036712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:11.036712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:11.041121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 283/571] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:11.041978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc521be-6bca-49e8-95e1-212bfd1b4971 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.094109 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733a2b-f8fa-406a-a486-948878c7490c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.129269 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183cbf1-7202-47e5-8a0d-b7dc0e1a8b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.129868 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183cbf1-7202-47e5-8a0d-b7dc0e1a8b32 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.130243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183cbf1-7202-47e5-8a0d-b7dc0e1a8b32 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.130411 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183cbf1-7202-47e5-8a0d-b7dc0e1a8b32 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.131079 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183cbf1-7202-47e5-8a0d-b7dc0e1a8b32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:11.131401 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183cbf1-7202-47e5-8a0d-b7dc0e1a8b32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.132735 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183cbf1-7202-47e5-8a0d-b7dc0e1a8b32 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.144192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 289/572] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:11.144963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183cbf1-7202-47e5-8a0d-b7dc0e1a8b32 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.146540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc521be-6bca-49e8-95e1-212bfd1b4971 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.181203 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc402-5bd9-4044-9f67-5ff15913d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.181781 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc402-5bd9-4044-9f67-5ff15913d783 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.182064 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc402-5bd9-4044-9f67-5ff15913d783 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.182338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc402-5bd9-4044-9f67-5ff15913d783 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.189808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fc402-5bd9-4044-9f67-5ff15913d783 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.191264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fc402-5bd9-4044-9f67-5ff15913d783 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-f83fc402-5bd9-4044-9f67-5ff15913d783 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:11.202654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:11.203637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 284/573] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:11.204574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc402-5bd9-4044-9f67-5ff15913d783 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.213121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.244710 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.249096 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183cbf1-7202-47e5-8a0d-b7dc0e1a8b32 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.282258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4634ef-5abd-455a-bef6-bd076c0d6b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.282863 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4634ef-5abd-455a-bef6-bd076c0d6b06 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.283169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4634ef-5abd-455a-bef6-bd076c0d6b06 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.283599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4634ef-5abd-455a-bef6-bd076c0d6b06 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4634ef-5abd-455a-bef6-bd076c0d6b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:11.284897 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4634ef-5abd-455a-bef6-bd076c0d6b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.286251 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4634ef-5abd-455a-bef6-bd076c0d6b06 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.298200 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 290/574] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:11.299176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4634ef-5abd-455a-bef6-bd076c0d6b06 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.306475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc402-5bd9-4044-9f67-5ff15913d783 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.339468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966873d-49f7-4a0b-b037-dd269b91810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.340152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966873d-49f7-4a0b-b037-dd269b91810e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.340428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966873d-49f7-4a0b-b037-dd269b91810e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.340698 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966873d-49f7-4a0b-b037-dd269b91810e None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.341370 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966873d-49f7-4a0b-b037-dd269b91810e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:11.342195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966873d-49f7-4a0b-b037-dd269b91810e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.343651 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966873d-49f7-4a0b-b037-dd269b91810e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.355284 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 285/575] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:11.356062 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966873d-49f7-4a0b-b037-dd269b91810e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.401516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4634ef-5abd-455a-bef6-bd076c0d6b06 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.422592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.438836 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd18e9-fad8-49d0-a290-12ec0870d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.439487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd18e9-fad8-49d0-a290-12ec0870d552 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.439698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd18e9-fad8-49d0-a290-12ec0870d552 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.439968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd18e9-fad8-49d0-a290-12ec0870d552 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.452236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd18e9-fad8-49d0-a290-12ec0870d552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:11.460347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966873d-49f7-4a0b-b037-dd269b91810e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-1cbd18e9-fad8-49d0-a290-12ec0870d552 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:11.460932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:11.462051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 291/576] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:11.463092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd18e9-fad8-49d0-a290-12ec0870d552 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.484351 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.498477 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49b02d-3b4c-4651-bb48-5f27495396ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.499158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b02d-3b4c-4651-bb48-5f27495396ec None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.499445 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b02d-3b4c-4651-bb48-5f27495396ec None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.499723 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b02d-3b4c-4651-bb48-5f27495396ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.507107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49b02d-3b4c-4651-bb48-5f27495396ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.508555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49b02d-3b4c-4651-bb48-5f27495396ec None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-5f49b02d-3b4c-4651-bb48-5f27495396ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:11.519813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:11.520925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 286/577] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:11.521866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49b02d-3b4c-4651-bb48-5f27495396ec None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.569521 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd18e9-fad8-49d0-a290-12ec0870d552 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.604764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0b1a5-fa97-4816-9b7a-98952419c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.605724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0b1a5-fa97-4816-9b7a-98952419c503 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.606005 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0b1a5-fa97-4816-9b7a-98952419c503 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.606276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0b1a5-fa97-4816-9b7a-98952419c503 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.607010 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0b1a5-fa97-4816-9b7a-98952419c503 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:11.607884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0b1a5-fa97-4816-9b7a-98952419c503 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.609433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0b1a5-fa97-4816-9b7a-98952419c503 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.623145 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49b02d-3b4c-4651-bb48-5f27495396ec None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.627219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 292/578] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:11.627851 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0b1a5-fa97-4816-9b7a-98952419c503 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.648046 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.657392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfea2bc-3dd9-44be-b032-8be8def66e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.658190 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfea2bc-3dd9-44be-b032-8be8def66e6d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.658465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfea2bc-3dd9-44be-b032-8be8def66e6d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.658733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfea2bc-3dd9-44be-b032-8be8def66e6d None admin] PATH_INFO: `/v3/users/glance` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.665882 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfea2bc-3dd9-44be-b032-8be8def66e6d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.667322 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfea2bc-3dd9-44be-b032-8be8def66e6d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-4dfea2bc-3dd9-44be-b032-8be8def66e6d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:11.678262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:11.679304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 287/579] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:11.680237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfea2bc-3dd9-44be-b032-8be8def66e6d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.706759 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.729933 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0b1a5-fa97-4816-9b7a-98952419c503 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.768106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f21d26-b7e7-4569-9eee-c6fd41fb35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.768711 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f21d26-b7e7-4569-9eee-c6fd41fb35fb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.768986 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f21d26-b7e7-4569-9eee-c6fd41fb35fb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.769253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f21d26-b7e7-4569-9eee-c6fd41fb35fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.769955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f21d26-b7e7-4569-9eee-c6fd41fb35fb None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=29b7487e76304a87bd9d07d1f63b01d3) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:11.770258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f21d26-b7e7-4569-9eee-c6fd41fb35fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.771687 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f21d26-b7e7-4569-9eee-c6fd41fb35fb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.777031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 293/580] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/role_assignments?user.id=29b7487e76304a87bd9d07d1f63b01d3&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:11.777963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f21d26-b7e7-4569-9eee-c6fd41fb35fb None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.797109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfea2bc-3dd9-44be-b032-8be8def66e6d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.839817 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3483eb-e976-4e04-82df-1bda6ff10acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.840454 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3483eb-e976-4e04-82df-1bda6ff10acf None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.840739 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3483eb-e976-4e04-82df-1bda6ff10acf None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.841017 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3483eb-e976-4e04-82df-1bda6ff10acf None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.841771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3483eb-e976-4e04-82df-1bda6ff10acf None admin] RBAC: Adding query filter params (name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:11.842074 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3483eb-e976-4e04-82df-1bda6ff10acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.843612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3483eb-e976-4e04-82df-1bda6ff10acf None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.852333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 288/581] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:11.853199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3483eb-e976-4e04-82df-1bda6ff10acf None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.895350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f21d26-b7e7-4569-9eee-c6fd41fb35fb None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:11.910652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.933020 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fdcb9-29bd-42a3-9d36-7ec776b61a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:11.933641 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fdcb9-29bd-42a3-9d36-7ec776b61a6a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:11.933925 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fdcb9-29bd-42a3-9d36-7ec776b61a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:11.934203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fdcb9-29bd-42a3-9d36-7ec776b61a6a None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:11.934941 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fdcb9-29bd-42a3-9d36-7ec776b61a6a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:11.935342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fdcb9-29bd-42a3-9d36-7ec776b61a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:11.937834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fdcb9-29bd-42a3-9d36-7ec776b61a6a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:11.948154 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:11.962813 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 294/582] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:11.962813 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fdcb9-29bd-42a3-9d36-7ec776b61a6a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:11.976494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3483eb-e976-4e04-82df-1bda6ff10acf None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.011765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65070f-8a72-4816-a47f-b47bbb749f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.012505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65070f-8a72-4816-a47f-b47bbb749f7a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.012791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65070f-8a72-4816-a47f-b47bbb749f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.013079 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65070f-8a72-4816-a47f-b47bbb749f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.024716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65070f-8a72-4816-a47f-b47bbb749f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.026369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65070f-8a72-4816-a47f-b47bbb749f7a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-ea65070f-8a72-4816-a47f-b47bbb749f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:12.041870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:12.042869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:12.043806 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:12.043806 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:12.043806 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:12.047969 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 289/583] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:12.048928 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65070f-8a72-4816-a47f-b47bbb749f7a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.070221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fdcb9-29bd-42a3-9d36-7ec776b61a6a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.116247 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab1eb1-f879-4446-a608-4b1a4b653afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.116863 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab1eb1-f879-4446-a608-4b1a4b653afb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.117151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab1eb1-f879-4446-a608-4b1a4b653afb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.117429 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab1eb1-f879-4446-a608-4b1a4b653afb None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.118152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab1eb1-f879-4446-a608-4b1a4b653afb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:12.118464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab1eb1-f879-4446-a608-4b1a4b653afb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.119915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab1eb1-f879-4446-a608-4b1a4b653afb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.137912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 295/584] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Oct 3 14:39:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:12.139599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab1eb1-f879-4446-a608-4b1a4b653afb None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.162110 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:12.166133 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65070f-8a72-4816-a47f-b47bbb749f7a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.205071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce2c63-0888-455a-a028-647280af363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.205702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce2c63-0888-455a-a028-647280af363a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.205987 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce2c63-0888-455a-a028-647280af363a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.206256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce2c63-0888-455a-a028-647280af363a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.206552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:12.217708 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce2c63-0888-455a-a028-647280af363a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.219210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce2c63-0888-455a-a028-647280af363a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c2ce2c63-0888-455a-a028-647280af363a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:12.234967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:12.235949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:12.236841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:12.236841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:12.236841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:12.236841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 290/585] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:12.236841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce2c63-0888-455a-a028-647280af363a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.260183 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab1eb1-f879-4446-a608-4b1a4b653afb None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.297081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ffd44-cfd1-4573-bf94-f0b792db932f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.297708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ffd44-cfd1-4573-bf94-f0b792db932f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.297983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ffd44-cfd1-4573-bf94-f0b792db932f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.298255 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ffd44-cfd1-4573-bf94-f0b792db932f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.308913 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ffd44-cfd1-4573-bf94-f0b792db932f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.310974 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ffd44-cfd1-4573-bf94-f0b792db932f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-810ffd44-cfd1-4573-bf94-f0b792db932f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:12.326574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:12.327825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:12.328730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:12.328730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:12.328730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:12.328730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 296/586] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:12.328993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ffd44-cfd1-4573-bf94-f0b792db932f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.347234 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce2c63-0888-455a-a028-647280af363a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.382421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623087ef-f56e-44f7-8229-39331ae99c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.383055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623087ef-f56e-44f7-8229-39331ae99c20 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.383332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623087ef-f56e-44f7-8229-39331ae99c20 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.383606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623087ef-f56e-44f7-8229-39331ae99c20 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.384239 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623087ef-f56e-44f7-8229-39331ae99c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:12.384537 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623087ef-f56e-44f7-8229-39331ae99c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.385886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623087ef-f56e-44f7-8229-39331ae99c20 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.402001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 291/587] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:12.402001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623087ef-f56e-44f7-8229-39331ae99c20 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.414187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:12.446237 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ffd44-cfd1-4573-bf94-f0b792db932f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.455322 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:12.481061 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797262a6-ca2e-4ab8-a9f3-bfd878da0e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.481913 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797262a6-ca2e-4ab8-a9f3-bfd878da0e80 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.483280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797262a6-ca2e-4ab8-a9f3-bfd878da0e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.483280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797262a6-ca2e-4ab8-a9f3-bfd878da0e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.494966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797262a6-ca2e-4ab8-a9f3-bfd878da0e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.496771 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797262a6-ca2e-4ab8-a9f3-bfd878da0e80 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.505772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623087ef-f56e-44f7-8229-39331ae99c20 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-797262a6-ca2e-4ab8-a9f3-bfd878da0e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:12.512413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:12.514458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:12.516657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:12.516657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:12.516657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:12.516657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 297/588] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:12.516657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797262a6-ca2e-4ab8-a9f3-bfd878da0e80 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.548823 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad79256-54e1-4833-89f1-572058dddd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.549439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad79256-54e1-4833-89f1-572058dddd3c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.549726 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad79256-54e1-4833-89f1-572058dddd3c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.549989 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad79256-54e1-4833-89f1-572058dddd3c None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.550627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad79256-54e1-4833-89f1-572058dddd3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:12.550919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad79256-54e1-4833-89f1-572058dddd3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.552325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad79256-54e1-4833-89f1-572058dddd3c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.569088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 292/589] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:12.569088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad79256-54e1-4833-89f1-572058dddd3c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.628988 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797262a6-ca2e-4ab8-a9f3-bfd878da0e80 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.642427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:12.665678 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea69f83-7fc0-40ce-bdba-fd6fa9981ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.666298 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea69f83-7fc0-40ce-bdba-fd6fa9981ed2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.666575 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea69f83-7fc0-40ce-bdba-fd6fa9981ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.666967 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea69f83-7fc0-40ce-bdba-fd6fa9981ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.667528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea69f83-7fc0-40ce-bdba-fd6fa9981ed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:12.667829 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea69f83-7fc0-40ce-bdba-fd6fa9981ed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.669186 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea69f83-7fc0-40ce-bdba-fd6fa9981ed2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.677771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad79256-54e1-4833-89f1-572058dddd3c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.688080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 298/590] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:12.688080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea69f83-7fc0-40ce-bdba-fd6fa9981ed2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.709559 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:12.718391 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c09c96-afbe-4d51-8db6-4c5382c9cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.719223 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c09c96-afbe-4d51-8db6-4c5382c9cb5e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.719672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c09c96-afbe-4d51-8db6-4c5382c9cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.720088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c09c96-afbe-4d51-8db6-4c5382c9cb5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.726772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c09c96-afbe-4d51-8db6-4c5382c9cb5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.728373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c09c96-afbe-4d51-8db6-4c5382c9cb5e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-d8c09c96-afbe-4d51-8db6-4c5382c9cb5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:12.740389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:12.741354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:12.742420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:12.742420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:12.742420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:12.742420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:12.742420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:12.742420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:12.742420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:12.742420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:12.744208 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 293/591] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:12.745234 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c09c96-afbe-4d51-8db6-4c5382c9cb5e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.804615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea69f83-7fc0-40ce-bdba-fd6fa9981ed2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.841182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e31e9-b21b-4365-9a4d-6c67bda191fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.841820 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e31e9-b21b-4365-9a4d-6c67bda191fc None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.842095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e31e9-b21b-4365-9a4d-6c67bda191fc None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.842369 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e31e9-b21b-4365-9a4d-6c67bda191fc None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.843024 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e31e9-b21b-4365-9a4d-6c67bda191fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:12.843328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e31e9-b21b-4365-9a4d-6c67bda191fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.844705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e31e9-b21b-4365-9a4d-6c67bda191fc None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.850912 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c09c96-afbe-4d51-8db6-4c5382c9cb5e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:12.855935 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 299/592] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:12.856734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e31e9-b21b-4365-9a4d-6c67bda191fc None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.882473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:12.887759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978c927-1df4-4ea0-9c42-013e79d0d25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:12.888920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978c927-1df4-4ea0-9c42-013e79d0d25b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:12.889859 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978c927-1df4-4ea0-9c42-013e79d0d25b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:12.890144 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978c927-1df4-4ea0-9c42-013e79d0d25b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:12.898385 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978c927-1df4-4ea0-9c42-013e79d0d25b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:12.899854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978c927-1df4-4ea0-9c42-013e79d0d25b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-f978c927-1df4-4ea0-9c42-013e79d0d25b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:12.911450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:12.912408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 294/593] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:12.913348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978c927-1df4-4ea0-9c42-013e79d0d25b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:12.954753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:12.977362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e31e9-b21b-4365-9a4d-6c67bda191fc None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.015212 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab62897-7d68-4a38-8daf-e05a664c1fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.015878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab62897-7d68-4a38-8daf-e05a664c1fa2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.016222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab62897-7d68-4a38-8daf-e05a664c1fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.016328 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978c927-1df4-4ea0-9c42-013e79d0d25b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.016611 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab62897-7d68-4a38-8daf-e05a664c1fa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.024633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab62897-7d68-4a38-8daf-e05a664c1fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.026258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab62897-7d68-4a38-8daf-e05a664c1fa2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-fab62897-7d68-4a38-8daf-e05a664c1fa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:13.039708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:13.040816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:13.041878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:13.041878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:13.041878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:13.041878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:13.041878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:13.041878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:13.041878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:13.041878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:13.041878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 300/594] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:13.046750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab62897-7d68-4a38-8daf-e05a664c1fa2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:13.053938 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96214d-5db4-4cd2-8163-6b672d0513e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.054622 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96214d-5db4-4cd2-8163-6b672d0513e5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.054996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96214d-5db4-4cd2-8163-6b672d0513e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.055350 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96214d-5db4-4cd2-8163-6b672d0513e5 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.056117 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96214d-5db4-4cd2-8163-6b672d0513e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:13.056487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96214d-5db4-4cd2-8163-6b672d0513e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.057964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96214d-5db4-4cd2-8163-6b672d0513e5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.075842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 295/595] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:13.075842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96214d-5db4-4cd2-8163-6b672d0513e5 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:13.130042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:13.167478 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab62897-7d68-4a38-8daf-e05a664c1fa2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.180408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96214d-5db4-4cd2-8163-6b672d0513e5 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.204686 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195677-9659-4dba-a3ce-4388c81f561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.205304 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195677-9659-4dba-a3ce-4388c81f561e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.205584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195677-9659-4dba-a3ce-4388c81f561e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.205857 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195677-9659-4dba-a3ce-4388c81f561e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.212552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21195677-9659-4dba-a3ce-4388c81f561e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.213970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21195677-9659-4dba-a3ce-4388c81f561e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.215559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0bf93-9c4f-4f71-8712-3d2590937693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.216166 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0bf93-9c4f-4f71-8712-3d2590937693 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.216518 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0bf93-9c4f-4f71-8712-3d2590937693 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.217158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0bf93-9c4f-4f71-8712-3d2590937693 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.217262 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:13.217504 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0bf93-9c4f-4f71-8712-3d2590937693 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:13.217811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0bf93-9c4f-4f71-8712-3d2590937693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.219481 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0bf93-9c4f-4f71-8712-3d2590937693 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-21195677-9659-4dba-a3ce-4388c81f561e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:13.227043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:13.227912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:13.228876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:13.228876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:13.228876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:13.228876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:13.228876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:13.228876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:13.228876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:13.228876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:13.228876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 301/596] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:13.229940 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195677-9659-4dba-a3ce-4388c81f561e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:13.243617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 296/597] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Oct 3 14:39:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:13.248495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0bf93-9c4f-4f71-8712-3d2590937693 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:13.339355 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195677-9659-4dba-a3ce-4388c81f561e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.351386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0bf93-9c4f-4f71-8712-3d2590937693 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.362485 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:13.379102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e73a7-7df4-4a00-85a8-435ce56098e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.379958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e73a7-7df4-4a00-85a8-435ce56098e2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.380561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e73a7-7df4-4a00-85a8-435ce56098e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.380848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e73a7-7df4-4a00-85a8-435ce56098e2 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.381688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e73a7-7df4-4a00-85a8-435ce56098e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:13.381998 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e73a7-7df4-4a00-85a8-435ce56098e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.383989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e73a7-7df4-4a00-85a8-435ce56098e2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.387530 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733449d8-b76e-41ca-b717-41f21d5220b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.388185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733449d8-b76e-41ca-b717-41f21d5220b7 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.388508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733449d8-b76e-41ca-b717-41f21d5220b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.388781 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733449d8-b76e-41ca-b717-41f21d5220b7 None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/bfb0254e89514ff18e1c91dc427e4b1e/roles/2a99e98f227647c7af60a10d5fe5ad3c` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.400687 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 302/598] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:13.400687 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e73a7-7df4-4a00-85a8-435ce56098e2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:13.408161 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733449d8-b76e-41ca-b717-41f21d5220b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=bfb0254e89514ff18e1c91dc427e4b1e, role_id=2a99e98f227647c7af60a10d5fe5ad3c)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.409777 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733449d8-b76e-41ca-b717-41f21d5220b7 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.431134 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 297/599] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:39:13 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/bfb0254e89514ff18e1c91dc427e4b1e/roles/2a99e98f227647c7af60a10d5fe5ad3c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:39:13.431134 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733449d8-b76e-41ca-b717-41f21d5220b7 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:13.485047 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:13.547096 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e73a7-7df4-4a00-85a8-435ce56098e2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.548817 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733449d8-b76e-41ca-b717-41f21d5220b7 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858af25-9e5b-4dcb-bd53-f834d374b50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.592040 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858af25-9e5b-4dcb-bd53-f834d374b50a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.592288 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858af25-9e5b-4dcb-bd53-f834d374b50a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.592570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858af25-9e5b-4dcb-bd53-f834d374b50a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.597890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5d423-5e8f-4c6b-a829-2799439a5afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.598682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5d423-5e8f-4c6b-a829-2799439a5afe None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.599111 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5d423-5e8f-4c6b-a829-2799439a5afe None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.599485 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5d423-5e8f-4c6b-a829-2799439a5afe None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.600389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5d423-5e8f-4c6b-a829-2799439a5afe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:13.600798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5d423-5e8f-4c6b-a829-2799439a5afe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.602424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5d423-5e8f-4c6b-a829-2799439a5afe None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.603881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858af25-9e5b-4dcb-bd53-f834d374b50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.605344 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858af25-9e5b-4dcb-bd53-f834d374b50a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.623516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 303/600] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:13.624741 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5d423-5e8f-4c6b-a829-2799439a5afe None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-a858af25-9e5b-4dcb-bd53-f834d374b50a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:13.626904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:13.627985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:13.628974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:13.628974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:13.628974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:13.632773 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 298/601] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:13.633693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858af25-9e5b-4dcb-bd53-f834d374b50a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:13.649898 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:13.752990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858af25-9e5b-4dcb-bd53-f834d374b50a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.761690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5d423-5e8f-4c6b-a829-2799439a5afe None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.792464 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12320a8-f653-4304-9913-97f2bcdf51f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.793290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12320a8-f653-4304-9913-97f2bcdf51f6 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.793529 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:13.793758 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12320a8-f653-4304-9913-97f2bcdf51f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.794136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12320a8-f653-4304-9913-97f2bcdf51f6 None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/f43a588d7ac34be7a8c2140a42e10dc0/roles/2a99e98f227647c7af60a10d5fe5ad3c` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.815417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12320a8-f653-4304-9913-97f2bcdf51f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=f43a588d7ac34be7a8c2140a42e10dc0, role_id=2a99e98f227647c7af60a10d5fe5ad3c)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.817161 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12320a8-f653-4304-9913-97f2bcdf51f6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.820249 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed9ead-c863-461f-b6ae-9283f8613bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:13.821799 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed9ead-c863-461f-b6ae-9283f8613bc3 None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.822112 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed9ead-c863-461f-b6ae-9283f8613bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.822376 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed9ead-c863-461f-b6ae-9283f8613bc3 None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/986544a87d444d57a9f6b2018f11967d/roles/2a99e98f227647c7af60a10d5fe5ad3c` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.833562 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 299/602] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:39:13 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/f43a588d7ac34be7a8c2140a42e10dc0/roles/2a99e98f227647c7af60a10d5fe5ad3c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:39:13.834764 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12320a8-f653-4304-9913-97f2bcdf51f6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:13.839688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed9ead-c863-461f-b6ae-9283f8613bc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=986544a87d444d57a9f6b2018f11967d, role_id=2a99e98f227647c7af60a10d5fe5ad3c)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:13.840843 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed9ead-c863-461f-b6ae-9283f8613bc3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:13.859540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 304/603] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:39:13 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/986544a87d444d57a9f6b2018f11967d/roles/2a99e98f227647c7af60a10d5fe5ad3c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:39:13.923072 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:13.973671 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12320a8-f653-4304-9913-97f2bcdf51f6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:13.989601 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d9901-122e-467b-ad90-d149b3aaccb6 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.989944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d9901-122e-467b-ad90-d149b3aaccb6 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.990158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d9901-122e-467b-ad90-d149b3aaccb6 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:13.991930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 305/604] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:13.998176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf89cc0-e557-4801-bfa1-56f8ff420673 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:13.998586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf89cc0-e557-4801-bfa1-56f8ff420673 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:13.998743 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf89cc0-e557-4801-bfa1-56f8ff420673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:14.019598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852c9fc-14ab-4361-9c6e-b4e0fa06467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:14.020777 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852c9fc-14ab-4361-9c6e-b4e0fa06467f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:14.021262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852c9fc-14ab-4361-9c6e-b4e0fa06467f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:14.021831 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852c9fc-14ab-4361-9c6e-b4e0fa06467f None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:14.022697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852c9fc-14ab-4361-9c6e-b4e0fa06467f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:14.023255 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852c9fc-14ab-4361-9c6e-b4e0fa06467f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:14.024863 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852c9fc-14ab-4361-9c6e-b4e0fa06467f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:14.039396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 300/605] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:14.049087 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-0bf89cc0-e557-4801-bfa1-56f8ff420673 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:14.049294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852c9fc-14ab-4361-9c6e-b4e0fa06467f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:14.049407 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-0bf89cc0-e557-4801-bfa1-56f8ff420673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:14.143203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 306/606] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:39:14.190828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852c9fc-14ab-4361-9c6e-b4e0fa06467f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:14.216327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:14.229246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39f24a-5c70-46f2-889d-43a8855dc785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:14.230215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39f24a-5c70-46f2-889d-43a8855dc785 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:14.230710 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39f24a-5c70-46f2-889d-43a8855dc785 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:14.231228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39f24a-5c70-46f2-889d-43a8855dc785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:14.238922 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39f24a-5c70-46f2-889d-43a8855dc785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:14.240629 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39f24a-5c70-46f2-889d-43a8855dc785 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-4a39f24a-5c70-46f2-889d-43a8855dc785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:14.252754 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:14.253667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:14.254549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:14.254549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:14.254549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:14.254549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:14.254549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:14.254549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:14.254549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:14.254549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:14.256972 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 301/607] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:14.264602 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf89cc0-e557-4801-bfa1-56f8ff420673 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:14.369544 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf89cc0-e557-4801-bfa1-56f8ff420673 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:14.371624 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:14.408400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baddbdc-0062-4c32-8882-5950d6a5dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:14.409359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baddbdc-0062-4c32-8882-5950d6a5dc87 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:14.409834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baddbdc-0062-4c32-8882-5950d6a5dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:14.410313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baddbdc-0062-4c32-8882-5950d6a5dc87 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:14.411232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baddbdc-0062-4c32-8882-5950d6a5dc87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:14.411732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baddbdc-0062-4c32-8882-5950d6a5dc87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:14.413365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baddbdc-0062-4c32-8882-5950d6a5dc87 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:14.426648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 307/608] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:14.436775 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39f24a-5c70-46f2-889d-43a8855dc785 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:14.566883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39f24a-5c70-46f2-889d-43a8855dc785 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:14.569468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baddbdc-0062-4c32-8882-5950d6a5dc87 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:14.606821 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5947e1-6e97-4cc3-a837-0287d0b62bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:14.608644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5947e1-6e97-4cc3-a837-0287d0b62bd7 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:14.609018 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5947e1-6e97-4cc3-a837-0287d0b62bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:14.609326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5947e1-6e97-4cc3-a837-0287d0b62bd7 None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/0561a97f1a4d4f469cb5c2103e2541f3/roles/2a99e98f227647c7af60a10d5fe5ad3c` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:14.641784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5947e1-6e97-4cc3-a837-0287d0b62bd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=0561a97f1a4d4f469cb5c2103e2541f3, role_id=2a99e98f227647c7af60a10d5fe5ad3c)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:14.643610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5947e1-6e97-4cc3-a837-0287d0b62bd7 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:14.663826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 302/609] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:39:14 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/0561a97f1a4d4f469cb5c2103e2541f3/roles/2a99e98f227647c7af60a10d5fe5ad3c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:39:14.729995 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baddbdc-0062-4c32-8882-5950d6a5dc87 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:14.772205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422d8c7-3047-41da-af0f-01f5f0d8adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:14.772848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d8c7-3047-41da-af0f-01f5f0d8adf5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:14.773131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d8c7-3047-41da-af0f-01f5f0d8adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:14.773404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d8c7-3047-41da-af0f-01f5f0d8adf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:14.785520 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422d8c7-3047-41da-af0f-01f5f0d8adf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-3422d8c7-3047-41da-af0f-01f5f0d8adf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:14.791132 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:14.792333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:14.793503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 308/610] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:14.800807 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5947e1-6e97-4cc3-a837-0287d0b62bd7 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:14.850752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:14.948164 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5947e1-6e97-4cc3-a837-0287d0b62bd7 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:14.988179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca79269-eb6f-48bd-a9b8-cefc7e7036f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:14.988783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca79269-eb6f-48bd-a9b8-cefc7e7036f5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:14.989058 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca79269-eb6f-48bd-a9b8-cefc7e7036f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:14.989329 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca79269-eb6f-48bd-a9b8-cefc7e7036f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:14.990063 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca79269-eb6f-48bd-a9b8-cefc7e7036f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:14.990361 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca79269-eb6f-48bd-a9b8-cefc7e7036f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:14.991763 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca79269-eb6f-48bd-a9b8-cefc7e7036f5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:15.005475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 303/611] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:15.011082 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422d8c7-3047-41da-af0f-01f5f0d8adf5 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:15.036833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:15.126101 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422d8c7-3047-41da-af0f-01f5f0d8adf5 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:15.175654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257c9a-f12f-4cac-bb12-d27515fad144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:15.176291 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257c9a-f12f-4cac-bb12-d27515fad144 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:15.176572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257c9a-f12f-4cac-bb12-d27515fad144 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:15.176841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257c9a-f12f-4cac-bb12-d27515fad144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:15.190594 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72257c9a-f12f-4cac-bb12-d27515fad144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:15.192038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72257c9a-f12f-4cac-bb12-d27515fad144 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-72257c9a-f12f-4cac-bb12-d27515fad144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:15.209032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:15.210021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:15.210990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:15.210990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:15.210990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:15.210990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 309/612] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:15.215994 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca79269-eb6f-48bd-a9b8-cefc7e7036f5 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:15.336893 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:15.349530 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca79269-eb6f-48bd-a9b8-cefc7e7036f5 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:15.388576 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833a6b1-43f6-4d9d-969d-232ed5cce982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:15.389236 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833a6b1-43f6-4d9d-969d-232ed5cce982 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:15.389517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833a6b1-43f6-4d9d-969d-232ed5cce982 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:15.389905 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833a6b1-43f6-4d9d-969d-232ed5cce982 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:15.390547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833a6b1-43f6-4d9d-969d-232ed5cce982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:15.390845 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833a6b1-43f6-4d9d-969d-232ed5cce982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:15.392221 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833a6b1-43f6-4d9d-969d-232ed5cce982 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:15.409353 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 304/613] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:15.410841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257c9a-f12f-4cac-bb12-d27515fad144 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:15.495669 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:15.539284 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257c9a-f12f-4cac-bb12-d27515fad144 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:15.591283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da83ce-27d6-400e-ab67-4345557dac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:15.592653 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da83ce-27d6-400e-ab67-4345557dac2d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:15.592885 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da83ce-27d6-400e-ab67-4345557dac2d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:15.593099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da83ce-27d6-400e-ab67-4345557dac2d None admin] PATH_INFO: `/v3/users/swift` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:15.602202 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da83ce-27d6-400e-ab67-4345557dac2d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:15.603753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da83ce-27d6-400e-ab67-4345557dac2d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-e8da83ce-27d6-400e-ab67-4345557dac2d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:15.615361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:15.616350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:15.617666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:15.621390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 310/614] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:15.623190 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833a6b1-43f6-4d9d-969d-232ed5cce982 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:15.726772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833a6b1-43f6-4d9d-969d-232ed5cce982 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:15.762602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8aabb-7d6c-4647-96fb-a9a4c0bfa3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:15.764182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8aabb-7d6c-4647-96fb-a9a4c0bfa3b9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:15.764182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8aabb-7d6c-4647-96fb-a9a4c0bfa3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:15.764868 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8aabb-7d6c-4647-96fb-a9a4c0bfa3b9 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:15.765376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8aabb-7d6c-4647-96fb-a9a4c0bfa3b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:15.765686 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8aabb-7d6c-4647-96fb-a9a4c0bfa3b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:15.767242 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8aabb-7d6c-4647-96fb-a9a4c0bfa3b9 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:15.790230 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 305/615] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Oct 3 14:39:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:15.791729 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da83ce-27d6-400e-ab67-4345557dac2d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:15.933552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da83ce-27d6-400e-ab67-4345557dac2d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:15.976342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:15.984900 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8536a86-f327-42c9-ac98-c00f00c11a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:15.985879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536a86-f327-42c9-ac98-c00f00c11a63 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:15.986395 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536a86-f327-42c9-ac98-c00f00c11a63 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:15.986878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8536a86-f327-42c9-ac98-c00f00c11a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:16.009434 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8536a86-f327-42c9-ac98-c00f00c11a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:16.011293 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8536a86-f327-42c9-ac98-c00f00c11a63 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-b8536a86-f327-42c9-ac98-c00f00c11a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:16.033045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:16.034008 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:16.034917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:16.034917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:16.034917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:16.037030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 311/616] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:16.046541 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8aabb-7d6c-4647-96fb-a9a4c0bfa3b9 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:16.073155 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:16.219052 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8aabb-7d6c-4647-96fb-a9a4c0bfa3b9 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:16.268552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aabcec-5b8a-4438-850e-d9810dfddda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:16.269180 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aabcec-5b8a-4438-850e-d9810dfddda4 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:16.269465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aabcec-5b8a-4438-850e-d9810dfddda4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:16.269740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aabcec-5b8a-4438-850e-d9810dfddda4 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:16.270380 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aabcec-5b8a-4438-850e-d9810dfddda4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:16.270688 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aabcec-5b8a-4438-850e-d9810dfddda4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:16.272066 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aabcec-5b8a-4438-850e-d9810dfddda4 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:16.293412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 306/617] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:16.294975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e02db4-f194-42eb-89da-bdd19258e1a3 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:16.295463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e02db4-f194-42eb-89da-bdd19258e1a3 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:16.295928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e02db4-f194-42eb-89da-bdd19258e1a3 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:16.297420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 312/618] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:16.299676 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aabcec-5b8a-4438-850e-d9810dfddda4 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:16.302425 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d793-077f-42d0-9300-70197e81ca7d None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:16.302712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d793-077f-42d0-9300-70197e81ca7d None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:16.303028 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d793-077f-42d0-9300-70197e81ca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:16.347856 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-e788d793-077f-42d0-9300-70197e81ca7d None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:16.349209 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-e788d793-077f-42d0-9300-70197e81ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:16.415342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:16.474998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aabcec-5b8a-4438-850e-d9810dfddda4 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:16.480232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 313/619] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:16.536792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd533-99b2-4106-a4b5-7e505ee90346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:16.537429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd533-99b2-4106-a4b5-7e505ee90346 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:16.537706 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd533-99b2-4106-a4b5-7e505ee90346 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:16.537976 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd533-99b2-4106-a4b5-7e505ee90346 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:16.550383 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafd533-99b2-4106-a4b5-7e505ee90346 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:16.551791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafd533-99b2-4106-a4b5-7e505ee90346 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-1aafd533-99b2-4106-a4b5-7e505ee90346 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:16.572237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:16.573191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:16.574497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:16.574497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:16.574497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:16.574497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:16.574497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:16.574497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:16.574497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:16.574497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:16.574497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 307/620] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:16.581856 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d793-077f-42d0-9300-70197e81ca7d None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:16.733394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d793-077f-42d0-9300-70197e81ca7d None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:16.753697 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:16.782647 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a6b57-b0cf-4069-8151-edf104d45442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:16.783730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a6b57-b0cf-4069-8151-edf104d45442 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:16.784233 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a6b57-b0cf-4069-8151-edf104d45442 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:16.784704 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a6b57-b0cf-4069-8151-edf104d45442 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:16.785604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a6b57-b0cf-4069-8151-edf104d45442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:16.786104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a6b57-b0cf-4069-8151-edf104d45442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:16.787758 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a6b57-b0cf-4069-8151-edf104d45442 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:16.805763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 314/621] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:16.812059 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd533-99b2-4106-a4b5-7e505ee90346 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:16.821309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a6b57-b0cf-4069-8151-edf104d45442 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:16.932873 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a6b57-b0cf-4069-8151-edf104d45442 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:16.956048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd533-99b2-4106-a4b5-7e505ee90346 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:16.970044 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8e02c-4d06-49d6-ac4e-c371f59e04c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:16.970816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e02c-4d06-49d6-ac4e-c371f59e04c5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:16.971131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e02c-4d06-49d6-ac4e-c371f59e04c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:16.971407 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8e02c-4d06-49d6-ac4e-c371f59e04c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:16.982922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8e02c-4d06-49d6-ac4e-c371f59e04c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:16.986908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-efb8e02c-4d06-49d6-ac4e-c371f59e04c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:16.990357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:16.991342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:16.992205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 315/622] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:16.992922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd5f0c-232a-4742-9d43-28d1f231132c None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:16.992922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd5f0c-232a-4742-9d43-28d1f231132c None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:16.993617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd5f0c-232a-4742-9d43-28d1f231132c None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:16.998441 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95bc96-e791-4d68-a0ef-cdf0020d976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:16.999249 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 316/623] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:16.999434 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95bc96-e791-4d68-a0ef-cdf0020d976e None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:16.999669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95bc96-e791-4d68-a0ef-cdf0020d976e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:16.999942 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95bc96-e791-4d68-a0ef-cdf0020d976e None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/29b7487e76304a87bd9d07d1f63b01d3/roles/2a99e98f227647c7af60a10d5fe5ad3c` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.000275 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565223-3ff7-45ff-b416-48f475eb22ca None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.000554 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565223-3ff7-45ff-b416-48f475eb22ca None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.000827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb565223-3ff7-45ff-b416-48f475eb22ca None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.002994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 317/624] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:17.002994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb565223-3ff7-45ff-b416-48f475eb22ca None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:17.019692 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95bc96-e791-4d68-a0ef-cdf0020d976e None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=29b7487e76304a87bd9d07d1f63b01d3, role_id=2a99e98f227647c7af60a10d5fe5ad3c)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:17.021138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95bc96-e791-4d68-a0ef-cdf0020d976e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:17.034541 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 308/625] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:39:16 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/29b7487e76304a87bd9d07d1f63b01d3/roles/2a99e98f227647c7af60a10d5fe5ad3c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:39:17.035884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307a317-2fc0-4c40-885d-ed7a8668b51e None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.036172 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307a317-2fc0-4c40-885d-ed7a8668b51e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.036445 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307a317-2fc0-4c40-885d-ed7a8668b51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.055908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-8307a317-2fc0-4c40-885d-ed7a8668b51e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:17.057029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-8307a317-2fc0-4c40-885d-ed7a8668b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:17.070118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:17.154977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 309/626] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:17.154977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4d12-bb7b-4fab-8b29-acf27b8fba21 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.154977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4d12-bb7b-4fab-8b29-acf27b8fba21 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.154977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4d12-bb7b-4fab-8b29-acf27b8fba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.156210 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb565223-3ff7-45ff-b416-48f475eb22ca None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:17.173672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-9a7e4d12-bb7b-4fab-8b29-acf27b8fba21 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:17.174427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-9a7e4d12-bb7b-4fab-8b29-acf27b8fba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:17.227548 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687aa58-8565-417c-b5bb-3b9326261942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:17.228183 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687aa58-8565-417c-b5bb-3b9326261942 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.228459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687aa58-8565-417c-b5bb-3b9326261942 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.228728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687aa58-8565-417c-b5bb-3b9326261942 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.229413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687aa58-8565-417c-b5bb-3b9326261942 None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:17.229717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687aa58-8565-417c-b5bb-3b9326261942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:17.231166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687aa58-8565-417c-b5bb-3b9326261942 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:17.247980 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 318/627] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:17.254053 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687aa58-8565-417c-b5bb-3b9326261942 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:17.301679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 310/628] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:17.355882 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c94fe-838b-4f37-80fa-e7840489ee8d None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.356322 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c94fe-838b-4f37-80fa-e7840489ee8d None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.356694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c94fe-838b-4f37-80fa-e7840489ee8d None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.358859 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 311/629] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:17.368259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3ed2-7307-43ca-94f7-c9a83a6efa0c None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.368670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3ed2-7307-43ca-94f7-c9a83a6efa0c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.369049 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3ed2-7307-43ca-94f7-c9a83a6efa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.380825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:17.393761 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687aa58-8565-417c-b5bb-3b9326261942 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:17.397262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-398a3ed2-7307-43ca-94f7-c9a83a6efa0c None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:17.398561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-398a3ed2-7307-43ca-94f7-c9a83a6efa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:17.443630 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:17.452729 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0211e81-cc8c-4b6c-917d-e62bba7bf314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:17.453378 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0211e81-cc8c-4b6c-917d-e62bba7bf314 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.453660 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0211e81-cc8c-4b6c-917d-e62bba7bf314 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.453933 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0211e81-cc8c-4b6c-917d-e62bba7bf314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.482280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0211e81-cc8c-4b6c-917d-e62bba7bf314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:17.483882 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0211e81-cc8c-4b6c-917d-e62bba7bf314 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:17.503152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 312/630] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:39:17.503152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3ed2-7307-43ca-94f7-c9a83a6efa0c None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-e0211e81-cc8c-4b6c-917d-e62bba7bf314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:17.503397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:17.504282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:17.505176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:17.505176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:17.505176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:17.508879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 319/631] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:17.510254 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0211e81-cc8c-4b6c-917d-e62bba7bf314 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:17.665696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0211e81-cc8c-4b6c-917d-e62bba7bf314 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:17.666791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3ed2-7307-43ca-94f7-c9a83a6efa0c None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:17.702072 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512eda-b70f-4fc6-bd20-1e15e25c26ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:17.702770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512eda-b70f-4fc6-bd20-1e15e25c26ae None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.703207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512eda-b70f-4fc6-bd20-1e15e25c26ae None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.703485 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512eda-b70f-4fc6-bd20-1e15e25c26ae None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.704351 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512eda-b70f-4fc6-bd20-1e15e25c26ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:17.704660 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512eda-b70f-4fc6-bd20-1e15e25c26ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:17.705190 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609023-1240-4985-8b41-ac65735bade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:17.705836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609023-1240-4985-8b41-ac65735bade4 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.706027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512eda-b70f-4fc6-bd20-1e15e25c26ae None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:17.706131 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609023-1240-4985-8b41-ac65735bade4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.706371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609023-1240-4985-8b41-ac65735bade4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.717764 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609023-1240-4985-8b41-ac65735bade4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-47609023-1240-4985-8b41-ac65735bade4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:17.722594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:17.723565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:17.724424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:17.725074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 320/632] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:17.725074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512eda-b70f-4fc6-bd20-1e15e25c26ae None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:17.725387 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 313/633] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:17.726522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609023-1240-4985-8b41-ac65735bade4 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:17.737645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:17.762722 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:17.844349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609023-1240-4985-8b41-ac65735bade4 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:17.852843 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512eda-b70f-4fc6-bd20-1e15e25c26ae None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:17.880564 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466c8b-2d2b-4591-9774-baf9e7e8b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:17.881230 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466c8b-2d2b-4591-9774-baf9e7e8b66b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.881618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466c8b-2d2b-4591-9774-baf9e7e8b66b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.881902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466c8b-2d2b-4591-9774-baf9e7e8b66b None admin] PATH_INFO: `/v3/users/nova` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.889696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc350a3-25c3-4b97-9daf-c18bf7ba2507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:17.889870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e466c8b-2d2b-4591-9774-baf9e7e8b66b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:17.890693 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc350a3-25c3-4b97-9daf-c18bf7ba2507 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:17.891155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc350a3-25c3-4b97-9daf-c18bf7ba2507 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:17.891270 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e466c8b-2d2b-4591-9774-baf9e7e8b66b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:17.891761 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc350a3-25c3-4b97-9daf-c18bf7ba2507 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:17.902451 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc350a3-25c3-4b97-9daf-c18bf7ba2507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-7e466c8b-2d2b-4591-9774-baf9e7e8b66b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:17.903589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:17.904570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 314/634] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Oct 3 14:39:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:17.910870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466c8b-2d2b-4591-9774-baf9e7e8b66b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-2cc350a3-25c3-4b97-9daf-c18bf7ba2507 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:17.911914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:17.912784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 321/635] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:17.914144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc350a3-25c3-4b97-9daf-c18bf7ba2507 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:17.986000 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:18.011991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:18.021294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc350a3-25c3-4b97-9daf-c18bf7ba2507 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.023781 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466c8b-2d2b-4591-9774-baf9e7e8b66b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.058482 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5cbef-40bc-4933-85f1-2e93672a6491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.058917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be726a-67df-46fc-85b1-b4f8c6df6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.059142 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5cbef-40bc-4933-85f1-2e93672a6491 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.059412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5cbef-40bc-4933-85f1-2e93672a6491 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.059574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be726a-67df-46fc-85b1-b4f8c6df6564 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.059677 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5cbef-40bc-4933-85f1-2e93672a6491 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.059842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be726a-67df-46fc-85b1-b4f8c6df6564 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.060641 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be726a-67df-46fc-85b1-b4f8c6df6564 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.061308 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be726a-67df-46fc-85b1-b4f8c6df6564 None admin] RBAC: Adding query filter params (name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:18.061608 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be726a-67df-46fc-85b1-b4f8c6df6564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.063237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be726a-67df-46fc-85b1-b4f8c6df6564 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.070612 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5cbef-40bc-4933-85f1-2e93672a6491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:18.076089 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 315/636] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:18.076089 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be726a-67df-46fc-85b1-b4f8c6df6564 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-29f5cbef-40bc-4933-85f1-2e93672a6491 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:18.076448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:18.077431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:18.078270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:18.081287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 322/637] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:18.082117 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5cbef-40bc-4933-85f1-2e93672a6491 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.189197 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be726a-67df-46fc-85b1-b4f8c6df6564 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.190773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5cbef-40bc-4933-85f1-2e93672a6491 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.217451 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:18.227101 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b304fe-cf6b-49b3-9d2d-8d35751130e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.227244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b472052-abe3-4e87-9225-45a5d411c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.227714 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b304fe-cf6b-49b3-9d2d-8d35751130e0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.227838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b472052-abe3-4e87-9225-45a5d411c8da None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.228023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b472052-abe3-4e87-9225-45a5d411c8da None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.228118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b304fe-cf6b-49b3-9d2d-8d35751130e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.228289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b472052-abe3-4e87-9225-45a5d411c8da None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.228389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b304fe-cf6b-49b3-9d2d-8d35751130e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.228968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b304fe-cf6b-49b3-9d2d-8d35751130e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:18.229147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b472052-abe3-4e87-9225-45a5d411c8da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:18.229298 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b472052-abe3-4e87-9225-45a5d411c8da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.229389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b304fe-cf6b-49b3-9d2d-8d35751130e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.230668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b472052-abe3-4e87-9225-45a5d411c8da None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.230765 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b304fe-cf6b-49b3-9d2d-8d35751130e0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.243508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 323/638] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:18.243508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b304fe-cf6b-49b3-9d2d-8d35751130e0 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.253900 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 316/639] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:18.254715 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b472052-abe3-4e87-9225-45a5d411c8da None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.269774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:18.357162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b304fe-cf6b-49b3-9d2d-8d35751130e0 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.358519 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b472052-abe3-4e87-9225-45a5d411c8da None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.393908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57622c0a-e5b5-49bf-a440-9cc4dfa388d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.394517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57622c0a-e5b5-49bf-a440-9cc4dfa388d8 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.394796 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57622c0a-e5b5-49bf-a440-9cc4dfa388d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.395098 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57622c0a-e5b5-49bf-a440-9cc4dfa388d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.395747 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57622c0a-e5b5-49bf-a440-9cc4dfa388d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:18.396037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57622c0a-e5b5-49bf-a440-9cc4dfa388d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.397379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57622c0a-e5b5-49bf-a440-9cc4dfa388d8 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.398131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4ad2e-96de-4b01-a80d-e7b43e26019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.399075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4ad2e-96de-4b01-a80d-e7b43e26019c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.399604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4ad2e-96de-4b01-a80d-e7b43e26019c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.400025 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4ad2e-96de-4b01-a80d-e7b43e26019c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.405625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 317/640] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:18.406399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57622c0a-e5b5-49bf-a440-9cc4dfa388d8 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.411952 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4ad2e-96de-4b01-a80d-e7b43e26019c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.414690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4ad2e-96de-4b01-a80d-e7b43e26019c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-d6e4ad2e-96de-4b01-a80d-e7b43e26019c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:18.435876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:18.437180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:18.438163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:18.438163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:18.438163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:18.438338 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 324/641] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:18.439111 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4ad2e-96de-4b01-a80d-e7b43e26019c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.484960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:18.500829 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:18.533487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57622c0a-e5b5-49bf-a440-9cc4dfa388d8 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.545421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4ad2e-96de-4b01-a80d-e7b43e26019c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.571991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cbfe1-18ca-41ef-b807-342441036175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.572647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cbfe1-18ca-41ef-b807-342441036175 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.572930 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cbfe1-18ca-41ef-b807-342441036175 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.573205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cbfe1-18ca-41ef-b807-342441036175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.582748 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcac6d-dc02-43c1-8930-c341b3e0779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.583360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcac6d-dc02-43c1-8930-c341b3e0779a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.583635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcac6d-dc02-43c1-8930-c341b3e0779a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.583901 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcac6d-dc02-43c1-8930-c341b3e0779a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.584515 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cbfe1-18ca-41ef-b807-342441036175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.585942 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cbfe1-18ca-41ef-b807-342441036175 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-839cbfe1-18ca-41ef-b807-342441036175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:18.600964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:18.601998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:18.602909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:18.602909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:18.602909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:18.602909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 318/642] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:18.602909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cbfe1-18ca-41ef-b807-342441036175 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.665654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcac6d-dc02-43c1-8930-c341b3e0779a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.668145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcac6d-dc02-43c1-8930-c341b3e0779a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.703901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cbfe1-18ca-41ef-b807-342441036175 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.721345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:18.729407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:18.739979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acba8f-9f74-40c0-a495-01320131d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.740610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acba8f-9f74-40c0-a495-01320131d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.740906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acba8f-9f74-40c0-a495-01320131d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.741170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acba8f-9f74-40c0-a495-01320131d5d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.752895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acba8f-9f74-40c0-a495-01320131d5d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.754571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acba8f-9f74-40c0-a495-01320131d5d6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-13acba8f-9f74-40c0-a495-01320131d5d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:18.768743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:18.769694 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:18.770741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:18.770741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:18.770741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:18.770741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 319/643] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:18.770741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acba8f-9f74-40c0-a495-01320131d5d6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.792407 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 325/644] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:18.793254 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcac6d-dc02-43c1-8930-c341b3e0779a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.881286 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acba8f-9f74-40c0-a495-01320131d5d6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.915510 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60452a4c-61d4-4882-878b-b4f6e1804b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.916122 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60452a4c-61d4-4882-878b-b4f6e1804b0a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.916406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60452a4c-61d4-4882-878b-b4f6e1804b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.916684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60452a4c-61d4-4882-878b-b4f6e1804b0a None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.917321 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60452a4c-61d4-4882-878b-b4f6e1804b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:18.917627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60452a4c-61d4-4882-878b-b4f6e1804b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.919014 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60452a4c-61d4-4882-878b-b4f6e1804b0a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.920435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcac6d-dc02-43c1-8930-c341b3e0779a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:18.936776 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 320/645] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:18.936776 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60452a4c-61d4-4882-878b-b4f6e1804b0a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.961315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a002248-2a62-4e97-8940-3607dfe23091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:18.961927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002248-2a62-4e97-8940-3607dfe23091 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:18.962215 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002248-2a62-4e97-8940-3607dfe23091 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:18.962489 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a002248-2a62-4e97-8940-3607dfe23091 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:18.963149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a002248-2a62-4e97-8940-3607dfe23091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:18.963452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a002248-2a62-4e97-8940-3607dfe23091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:18.964802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a002248-2a62-4e97-8940-3607dfe23091 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:18.977253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 326/646] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:18.977869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:18.983083 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a002248-2a62-4e97-8940-3607dfe23091 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:18.985910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:19.042779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60452a4c-61d4-4882-878b-b4f6e1804b0a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.078778 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70842f85-e1ea-45ee-ad5c-8d8da07be924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.079416 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842f85-e1ea-45ee-ad5c-8d8da07be924 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.079712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842f85-e1ea-45ee-ad5c-8d8da07be924 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.079963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842f85-e1ea-45ee-ad5c-8d8da07be924 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.080592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70842f85-e1ea-45ee-ad5c-8d8da07be924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:19.080893 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70842f85-e1ea-45ee-ad5c-8d8da07be924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.082240 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70842f85-e1ea-45ee-ad5c-8d8da07be924 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.103126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a002248-2a62-4e97-8940-3607dfe23091 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.103326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 321/647] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:19.103326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70842f85-e1ea-45ee-ad5c-8d8da07be924 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.140524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ebee2-aef9-4b5a-b852-f9a9dc54bf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.141157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ebee2-aef9-4b5a-b852-f9a9dc54bf09 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.141487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ebee2-aef9-4b5a-b852-f9a9dc54bf09 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.141768 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ebee2-aef9-4b5a-b852-f9a9dc54bf09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.155831 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ebee2-aef9-4b5a-b852-f9a9dc54bf09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.158540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ebee2-aef9-4b5a-b852-f9a9dc54bf09 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-862ebee2-aef9-4b5a-b852-f9a9dc54bf09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:19.174890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:19.175886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:19.176782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:19.176782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:19.176782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:19.176782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 327/648] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:19.176782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ebee2-aef9-4b5a-b852-f9a9dc54bf09 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.214977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:19.220351 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70842f85-e1ea-45ee-ad5c-8d8da07be924 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.241564 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:19.258667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42e6bc-8d2d-4082-bf39-fa5d195d9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.259335 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42e6bc-8d2d-4082-bf39-fa5d195d9c0b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.259618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42e6bc-8d2d-4082-bf39-fa5d195d9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.259892 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42e6bc-8d2d-4082-bf39-fa5d195d9c0b None admin] PATH_INFO: `/v3/users/glance` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.269186 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42e6bc-8d2d-4082-bf39-fa5d195d9c0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.270675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42e6bc-8d2d-4082-bf39-fa5d195d9c0b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-5f42e6bc-8d2d-4082-bf39-fa5d195d9c0b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:19.283527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:19.284547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:19.285513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 322/649] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:19.286123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42e6bc-8d2d-4082-bf39-fa5d195d9c0b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.297104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ebee2-aef9-4b5a-b852-f9a9dc54bf09 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.336969 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea187-dff2-4f1e-8fb5-28608aaca36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.337630 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea187-dff2-4f1e-8fb5-28608aaca36d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.337915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea187-dff2-4f1e-8fb5-28608aaca36d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.338190 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecea187-dff2-4f1e-8fb5-28608aaca36d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.347166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecea187-dff2-4f1e-8fb5-28608aaca36d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.348589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecea187-dff2-4f1e-8fb5-28608aaca36d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-6ecea187-dff2-4f1e-8fb5-28608aaca36d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:19.360328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:19.361302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 14:39:19.362263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:19.364410 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 328/650] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:19.365334 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea187-dff2-4f1e-8fb5-28608aaca36d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.405409 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42e6bc-8d2d-4082-bf39-fa5d195d9c0b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.438748 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0973791-ae88-411e-abe0-8a73a3272a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.439413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973791-ae88-411e-abe0-8a73a3272a3d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.439693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973791-ae88-411e-abe0-8a73a3272a3d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.439961 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973791-ae88-411e-abe0-8a73a3272a3d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.447500 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0973791-ae88-411e-abe0-8a73a3272a3d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.448937 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0973791-ae88-411e-abe0-8a73a3272a3d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-a0973791-ae88-411e-abe0-8a73a3272a3d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:19.460139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:19.461085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 323/651] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:19.462120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0973791-ae88-411e-abe0-8a73a3272a3d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.469654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecea187-dff2-4f1e-8fb5-28608aaca36d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.480209 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:19.483775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:19.506007 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28006f48-c909-4a8f-9941-2c54552d7789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.506617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006f48-c909-4a8f-9941-2c54552d7789 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.506900 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006f48-c909-4a8f-9941-2c54552d7789 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.507217 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28006f48-c909-4a8f-9941-2c54552d7789 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.507854 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006f48-c909-4a8f-9941-2c54552d7789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:19.508188 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006f48-c909-4a8f-9941-2c54552d7789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.509539 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28006f48-c909-4a8f-9941-2c54552d7789 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.521636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 329/652] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:19.522419 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28006f48-c909-4a8f-9941-2c54552d7789 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.563413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0973791-ae88-411e-abe0-8a73a3272a3d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.596503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2711105-f838-4dca-9230-9835968caa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.597104 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2711105-f838-4dca-9230-9835968caa7d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.597382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2711105-f838-4dca-9230-9835968caa7d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.597652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2711105-f838-4dca-9230-9835968caa7d None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.598356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2711105-f838-4dca-9230-9835968caa7d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:19.598658 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2711105-f838-4dca-9230-9835968caa7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.600112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2711105-f838-4dca-9230-9835968caa7d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.616833 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 324/653] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:19.620978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38390e-98d2-4a7e-8339-e713f3c12d86 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.621281 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38390e-98d2-4a7e-8339-e713f3c12d86 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.621711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38390e-98d2-4a7e-8339-e713f3c12d86 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.623505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 325/654] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:19.624254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38390e-98d2-4a7e-8339-e713f3c12d86 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.625954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28006f48-c909-4a8f-9941-2c54552d7789 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.661155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07619c16-401f-426f-add5-943040944197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.661757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07619c16-401f-426f-add5-943040944197 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.662036 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07619c16-401f-426f-add5-943040944197 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.662308 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07619c16-401f-426f-add5-943040944197 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.663061 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07619c16-401f-426f-add5-943040944197 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:19.663367 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07619c16-401f-426f-add5-943040944197 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.664765 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07619c16-401f-426f-add5-943040944197 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.682260 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 330/655] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:19.683075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07619c16-401f-426f-add5-943040944197 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.705042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:19.713427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:19.728613 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38390e-98d2-4a7e-8339-e713f3c12d86 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.763160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfafdb-02b5-44f7-9171-df05fbf8703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.763761 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfafdb-02b5-44f7-9171-df05fbf8703e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.764042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfafdb-02b5-44f7-9171-df05fbf8703e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.764307 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfafdb-02b5-44f7-9171-df05fbf8703e None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.765018 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfafdb-02b5-44f7-9171-df05fbf8703e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:19.765316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfafdb-02b5-44f7-9171-df05fbf8703e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.766719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfafdb-02b5-44f7-9171-df05fbf8703e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.783157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07619c16-401f-426f-add5-943040944197 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.784000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 326/656] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:19.784784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfafdb-02b5-44f7-9171-df05fbf8703e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.821795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d237c4a-eb7d-494e-9bb0-1988e646c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.822347 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d237c4a-eb7d-494e-9bb0-1988e646c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.822624 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d237c4a-eb7d-494e-9bb0-1988e646c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.822892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d237c4a-eb7d-494e-9bb0-1988e646c2c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.830326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d237c4a-eb7d-494e-9bb0-1988e646c2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.831754 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d237c4a-eb7d-494e-9bb0-1988e646c2c3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-2d237c4a-eb7d-494e-9bb0-1988e646c2c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:19.843150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:19.844124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:19.845015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:19.845015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:19.845015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:19.845015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:19.845015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:19.845015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:19.845015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:19.845015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:19.845015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 331/657] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:19.845500 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224acef7-50dc-4823-b3d6-48a9bb786c1f None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.845576 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224acef7-50dc-4823-b3d6-48a9bb786c1f None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.845860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224acef7-50dc-4823-b3d6-48a9bb786c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.863441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-224acef7-50dc-4823-b3d6-48a9bb786c1f None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:19.864608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-224acef7-50dc-4823-b3d6-48a9bb786c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:19.886784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfafdb-02b5-44f7-9171-df05fbf8703e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:19.920101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea32a4-55ba-47ef-b61a-a447b09c6a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:19.920716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea32a4-55ba-47ef-b61a-a447b09c6a8b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:19.921001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea32a4-55ba-47ef-b61a-a447b09c6a8b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:19.921280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea32a4-55ba-47ef-b61a-a447b09c6a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:19.923988 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:19.932082 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 332/658] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:19.932902 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224acef7-50dc-4823-b3d6-48a9bb786c1f None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:19.969068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:19.993430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea32a4-55ba-47ef-b61a-a447b09c6a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:19.994873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea32a4-55ba-47ef-b61a-a447b09c6a8b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:20.053721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224acef7-50dc-4823-b3d6-48a9bb786c1f None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:20.092118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446e01d-80f6-4033-ad14-51599fb10853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:20.092906 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446e01d-80f6-4033-ad14-51599fb10853 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:20.093314 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446e01d-80f6-4033-ad14-51599fb10853 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:20.093738 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446e01d-80f6-4033-ad14-51599fb10853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:20.107782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 327/659] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:20.108555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea32a4-55ba-47ef-b61a-a447b09c6a8b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:20.145013 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:20.166351 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446e01d-80f6-4033-ad14-51599fb10853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:20.167837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446e01d-80f6-4033-ad14-51599fb10853 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:20.191122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:20.220719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea32a4-55ba-47ef-b61a-a447b09c6a8b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:20.255056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eb0ab-2cc5-47e4-8cd7-47b6adfdefab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:20.255701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb0ab-2cc5-47e4-8cd7-47b6adfdefab None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:20.255984 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb0ab-2cc5-47e4-8cd7-47b6adfdefab None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:20.256257 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb0ab-2cc5-47e4-8cd7-47b6adfdefab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:20.267558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 333/660] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:20.272169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446e01d-80f6-4033-ad14-51599fb10853 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:20.326406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795eb0ab-2cc5-47e4-8cd7-47b6adfdefab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:20.328138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795eb0ab-2cc5-47e4-8cd7-47b6adfdefab None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:20.360261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:20.363506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446e01d-80f6-4033-ad14-51599fb10853 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:20.386667 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:20.398400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4385f3-f3b9-4d3e-bf22-41fb33cf87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:20.399030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4385f3-f3b9-4d3e-bf22-41fb33cf87ad None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:20.399309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4385f3-f3b9-4d3e-bf22-41fb33cf87ad None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:20.399588 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4385f3-f3b9-4d3e-bf22-41fb33cf87ad None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:20.400266 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4385f3-f3b9-4d3e-bf22-41fb33cf87ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:20.400572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4385f3-f3b9-4d3e-bf22-41fb33cf87ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:20.401977 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4385f3-f3b9-4d3e-bf22-41fb33cf87ad None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:20.413924 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 334/661] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:20.414700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4385f3-f3b9-4d3e-bf22-41fb33cf87ad None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:20.431285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 328/662] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:20.431285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eb0ab-2cc5-47e4-8cd7-47b6adfdefab None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:20.514633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4385f3-f3b9-4d3e-bf22-41fb33cf87ad None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:20.525305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eb0ab-2cc5-47e4-8cd7-47b6adfdefab None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:20.548673 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a355d6-ea10-4fbf-98be-9ee22bc2e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:20.549311 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a355d6-ea10-4fbf-98be-9ee22bc2e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:20.549593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a355d6-ea10-4fbf-98be-9ee22bc2e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:20.549876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a355d6-ea10-4fbf-98be-9ee22bc2e6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:20.559793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a26373-7e52-46d5-a548-1cf1a51886c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:20.560517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a355d6-ea10-4fbf-98be-9ee22bc2e6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:20.560723 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a26373-7e52-46d5-a548-1cf1a51886c7 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:20.561009 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a26373-7e52-46d5-a548-1cf1a51886c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:20.561286 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a26373-7e52-46d5-a548-1cf1a51886c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:20.561964 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a355d6-ea10-4fbf-98be-9ee22bc2e6f4 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:20.563077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:20.573815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a26373-7e52-46d5-a548-1cf1a51886c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-07a355d6-ea10-4fbf-98be-9ee22bc2e6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:20.577760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:20.578719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:20.583315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:20.583315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:20.583315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-48a26373-7e52-46d5-a548-1cf1a51886c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:20.583602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:20.584904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:20.585766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:20.586396 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 335/663] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:20.586396 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a355d6-ea10-4fbf-98be-9ee22bc2e6f4 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:20.586535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 329/664] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:20.586535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a26373-7e52-46d5-a548-1cf1a51886c7 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:20.619376 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:20.681938 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a26373-7e52-46d5-a548-1cf1a51886c7 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:20.684994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a355d6-ea10-4fbf-98be-9ee22bc2e6f4 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:20.715723 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4418692-e5eb-4102-b3a8-4a756f82acc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:20.716946 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4418692-e5eb-4102-b3a8-4a756f82acc9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:20.717260 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4418692-e5eb-4102-b3a8-4a756f82acc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:20.717533 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4418692-e5eb-4102-b3a8-4a756f82acc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:20.717738 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb383a-bbda-41d7-83aa-2874e0a3fefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:20.718245 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4418692-e5eb-4102-b3a8-4a756f82acc9 None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=bfb0254e89514ff18e1c91dc427e4b1e) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:20.718364 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb383a-bbda-41d7-83aa-2874e0a3fefc None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:20.718552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4418692-e5eb-4102-b3a8-4a756f82acc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:20.718642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb383a-bbda-41d7-83aa-2874e0a3fefc None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:20.718906 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb383a-bbda-41d7-83aa-2874e0a3fefc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:20.720031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4418692-e5eb-4102-b3a8-4a756f82acc9 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:20.725618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 330/665] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/role_assignments?user.id=bfb0254e89514ff18e1c91dc427e4b1e&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:20.726396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4418692-e5eb-4102-b3a8-4a756f82acc9 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:20.729655 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb383a-bbda-41d7-83aa-2874e0a3fefc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:20.731146 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb383a-bbda-41d7-83aa-2874e0a3fefc None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-c7eb383a-bbda-41d7-83aa-2874e0a3fefc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:20.747651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:20.748788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:20.750149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:20.750149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:20.750149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:20.750149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 336/666] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:20.750149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb383a-bbda-41d7-83aa-2874e0a3fefc None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:20.796106 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:20.842317 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4418692-e5eb-4102-b3a8-4a756f82acc9 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:20.853204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:20.880540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb383a-bbda-41d7-83aa-2874e0a3fefc None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:20.881566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc390-0679-4566-9b62-5d681fa6991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:20.882281 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc390-0679-4566-9b62-5d681fa6991d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:20.882574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc390-0679-4566-9b62-5d681fa6991d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:20.882852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc390-0679-4566-9b62-5d681fa6991d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:20.894205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdc390-0679-4566-9b62-5d681fa6991d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:20.895691 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdc390-0679-4566-9b62-5d681fa6991d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-b1fdc390-0679-4566-9b62-5d681fa6991d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:20.912495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:20.913494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:20.914389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:20.914389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:20.914389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:20.914389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 331/667] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:20.914389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc390-0679-4566-9b62-5d681fa6991d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:20.924439 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb182-bb6a-4d69-b36d-c2e8aaa54125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:20.925276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb182-bb6a-4d69-b36d-c2e8aaa54125 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:20.925720 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb182-bb6a-4d69-b36d-c2e8aaa54125 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:20.926003 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aecb182-bb6a-4d69-b36d-c2e8aaa54125 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:20.926666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb182-bb6a-4d69-b36d-c2e8aaa54125 None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:20.927007 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb182-bb6a-4d69-b36d-c2e8aaa54125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:20.928371 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aecb182-bb6a-4d69-b36d-c2e8aaa54125 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:20.937412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 337/668] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:20.938273 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb182-bb6a-4d69-b36d-c2e8aaa54125 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.028925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc390-0679-4566-9b62-5d681fa6991d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.040245 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:21.053404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aecb182-bb6a-4d69-b36d-c2e8aaa54125 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.067422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2f81f-86e7-4c2b-bb12-974359eceec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.068328 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f81f-86e7-4c2b-bb12-974359eceec5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.068790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f81f-86e7-4c2b-bb12-974359eceec5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.069239 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2f81f-86e7-4c2b-bb12-974359eceec5 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.070071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2f81f-86e7-4c2b-bb12-974359eceec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:21.070552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2f81f-86e7-4c2b-bb12-974359eceec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.072138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2f81f-86e7-4c2b-bb12-974359eceec5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.084604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 332/669] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:21.085657 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2f81f-86e7-4c2b-bb12-974359eceec5 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.101011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2ab37-52bd-490a-9e90-b44954f1c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.101637 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2ab37-52bd-490a-9e90-b44954f1c12d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.101925 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2ab37-52bd-490a-9e90-b44954f1c12d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.102204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2ab37-52bd-490a-9e90-b44954f1c12d None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.102850 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2ab37-52bd-490a-9e90-b44954f1c12d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:21.103188 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2ab37-52bd-490a-9e90-b44954f1c12d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.104563 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2ab37-52bd-490a-9e90-b44954f1c12d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.122672 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 338/670] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:21.122672 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2ab37-52bd-490a-9e90-b44954f1c12d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.131749 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:21.201274 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2f81f-86e7-4c2b-bb12-974359eceec5 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.228210 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2ab37-52bd-490a-9e90-b44954f1c12d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.237448 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8940a4-fb20-42d8-8a7a-5b51f6441434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.238064 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8940a4-fb20-42d8-8a7a-5b51f6441434 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.238688 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8940a4-fb20-42d8-8a7a-5b51f6441434 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.239000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8940a4-fb20-42d8-8a7a-5b51f6441434 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.239630 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8940a4-fb20-42d8-8a7a-5b51f6441434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:21.240246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8940a4-fb20-42d8-8a7a-5b51f6441434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.241596 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8940a4-fb20-42d8-8a7a-5b51f6441434 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.257984 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 333/671] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:21.258783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8940a4-fb20-42d8-8a7a-5b51f6441434 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.266668 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3ed54-0693-4978-b824-878e88d4eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.267349 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3ed54-0693-4978-b824-878e88d4eee3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.267630 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3ed54-0693-4978-b824-878e88d4eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.267900 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3ed54-0693-4978-b824-878e88d4eee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.281398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3ed54-0693-4978-b824-878e88d4eee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.282847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3ed54-0693-4978-b824-878e88d4eee3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.290238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-5af3ed54-0693-4978-b824-878e88d4eee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:21.298263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:21.299414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:21.304954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:21.304954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:21.304954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:21.304954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 339/672] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:21.304954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3ed54-0693-4978-b824-878e88d4eee3 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.365910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:21.373414 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8940a4-fb20-42d8-8a7a-5b51f6441434 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.410507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40ded2-8355-4b0a-b1c6-28ee73ba9632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.411106 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ded2-8355-4b0a-b1c6-28ee73ba9632 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.411390 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ded2-8355-4b0a-b1c6-28ee73ba9632 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.411666 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40ded2-8355-4b0a-b1c6-28ee73ba9632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.413663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3ed54-0693-4978-b824-878e88d4eee3 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.418328 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40ded2-8355-4b0a-b1c6-28ee73ba9632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.420374 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40ded2-8355-4b0a-b1c6-28ee73ba9632 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-1f40ded2-8355-4b0a-b1c6-28ee73ba9632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:21.432311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:21.433635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 334/673] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:21.434572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40ded2-8355-4b0a-b1c6-28ee73ba9632 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.455828 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706751-ea8c-46b4-9c89-edc6f184ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.456462 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706751-ea8c-46b4-9c89-edc6f184ec6a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.456747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706751-ea8c-46b4-9c89-edc6f184ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.457022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706751-ea8c-46b4-9c89-edc6f184ec6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.463818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0706751-ea8c-46b4-9c89-edc6f184ec6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.465225 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0706751-ea8c-46b4-9c89-edc6f184ec6a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-b0706751-ea8c-46b4-9c89-edc6f184ec6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:21.479086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:21.480015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 340/674] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:21.486504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706751-ea8c-46b4-9c89-edc6f184ec6a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.537895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:21.550088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40ded2-8355-4b0a-b1c6-28ee73ba9632 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.586563 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a871c0-c731-4794-861b-747983b28b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.587347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a871c0-c731-4794-861b-747983b28b8c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.587741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a871c0-c731-4794-861b-747983b28b8c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.588017 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a871c0-c731-4794-861b-747983b28b8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.593400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706751-ea8c-46b4-9c89-edc6f184ec6a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.595123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a871c0-c731-4794-861b-747983b28b8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.596733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a871c0-c731-4794-861b-747983b28b8c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-52a871c0-c731-4794-861b-747983b28b8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:21.609163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:21.610077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:21.611006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:21.611006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:21.611006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:21.611006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:21.611006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:21.611006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:21.611006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:21.611006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:21.611006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 335/675] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:21.612163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a871c0-c731-4794-861b-747983b28b8c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.618933 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:21.634824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c99e8-a96c-4103-b6e4-5ab9a9a75731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.635541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c99e8-a96c-4103-b6e4-5ab9a9a75731 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.635828 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c99e8-a96c-4103-b6e4-5ab9a9a75731 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.636102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c99e8-a96c-4103-b6e4-5ab9a9a75731 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.636768 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c99e8-a96c-4103-b6e4-5ab9a9a75731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:21.637075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c99e8-a96c-4103-b6e4-5ab9a9a75731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.639169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c99e8-a96c-4103-b6e4-5ab9a9a75731 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.655944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 341/676] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:21.655944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c99e8-a96c-4103-b6e4-5ab9a9a75731 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.721097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a871c0-c731-4794-861b-747983b28b8c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.755157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d657c-3555-40d5-a03c-5e0abdb419a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.755766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d657c-3555-40d5-a03c-5e0abdb419a1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.756041 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d657c-3555-40d5-a03c-5e0abdb419a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.756310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d657c-3555-40d5-a03c-5e0abdb419a1 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.756993 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d657c-3555-40d5-a03c-5e0abdb419a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:21.757290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d657c-3555-40d5-a03c-5e0abdb419a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.758698 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d657c-3555-40d5-a03c-5e0abdb419a1 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.764818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c99e8-a96c-4103-b6e4-5ab9a9a75731 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.775830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 336/677] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:21.775830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d657c-3555-40d5-a03c-5e0abdb419a1 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.788329 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:21.805210 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a5b3f-077a-4430-9870-c5a34f510ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.806034 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a5b3f-077a-4430-9870-c5a34f510ef8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.806458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a5b3f-077a-4430-9870-c5a34f510ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.806873 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a5b3f-077a-4430-9870-c5a34f510ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.807711 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a5b3f-077a-4430-9870-c5a34f510ef8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:21.808160 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a5b3f-077a-4430-9870-c5a34f510ef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.809732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a5b3f-077a-4430-9870-c5a34f510ef8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.821953 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 342/678] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:21.822899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a5b3f-077a-4430-9870-c5a34f510ef8 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.868669 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:21.894883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d657c-3555-40d5-a03c-5e0abdb419a1 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.931886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae23ce-54ed-4e4c-8abd-0ae900d2257d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.932595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae23ce-54ed-4e4c-8abd-0ae900d2257d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.932948 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae23ce-54ed-4e4c-8abd-0ae900d2257d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.933044 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a5b3f-077a-4430-9870-c5a34f510ef8 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:21.933354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae23ce-54ed-4e4c-8abd-0ae900d2257d None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.934137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae23ce-54ed-4e4c-8abd-0ae900d2257d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:21.934514 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae23ce-54ed-4e4c-8abd-0ae900d2257d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.936582 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae23ce-54ed-4e4c-8abd-0ae900d2257d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.954470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 337/679] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:21.954470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae23ce-54ed-4e4c-8abd-0ae900d2257d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:21.969367 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3776-ab76-496d-9d33-3b712eaf09aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:21.970002 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3776-ab76-496d-9d33-3b712eaf09aa None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:21.970286 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3776-ab76-496d-9d33-3b712eaf09aa None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:21.970559 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3776-ab76-496d-9d33-3b712eaf09aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:21.978989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc3776-ab76-496d-9d33-3b712eaf09aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:21.980968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc3776-ab76-496d-9d33-3b712eaf09aa None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-3bcc3776-ab76-496d-9d33-3b712eaf09aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:21.993299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:21.994446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:21.996019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:21.998940 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 343/680] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:21.999796 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3776-ab76-496d-9d33-3b712eaf09aa None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:22.028256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:22.062460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae23ce-54ed-4e4c-8abd-0ae900d2257d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:22.103920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ed26f-e5e1-4412-83d3-14151d70268a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:22.104526 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed26f-e5e1-4412-83d3-14151d70268a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:22.104802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed26f-e5e1-4412-83d3-14151d70268a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:22.105102 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed26f-e5e1-4412-83d3-14151d70268a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:22.105788 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ed26f-e5e1-4412-83d3-14151d70268a None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=f43a588d7ac34be7a8c2140a42e10dc0) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:22.106285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ed26f-e5e1-4412-83d3-14151d70268a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:22.107711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ed26f-e5e1-4412-83d3-14151d70268a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:22.109802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:22.113447 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3776-ab76-496d-9d33-3b712eaf09aa None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:22.113565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 338/681] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/role_assignments?user.id=f43a588d7ac34be7a8c2140a42e10dc0&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:22.114333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ed26f-e5e1-4412-83d3-14151d70268a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:22.158339 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43223f-a1e8-438c-8af2-a7b1efb5915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:22.159247 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43223f-a1e8-438c-8af2-a7b1efb5915a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:22.159699 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43223f-a1e8-438c-8af2-a7b1efb5915a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:22.160378 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43223f-a1e8-438c-8af2-a7b1efb5915a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:22.161720 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43223f-a1e8-438c-8af2-a7b1efb5915a None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=986544a87d444d57a9f6b2018f11967d) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:22.162421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43223f-a1e8-438c-8af2-a7b1efb5915a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:22.164237 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43223f-a1e8-438c-8af2-a7b1efb5915a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:22.173029 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 344/682] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:21 2022] GET /identity/v3/role_assignments?user.id=986544a87d444d57a9f6b2018f11967d&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:22.174238 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43223f-a1e8-438c-8af2-a7b1efb5915a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:22.315702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ed26f-e5e1-4412-83d3-14151d70268a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:22.363531 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d7d4-0072-4479-b097-0a8afc1de58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:22.364408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d7d4-0072-4479-b097-0a8afc1de58b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:22.364927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d7d4-0072-4479-b097-0a8afc1de58b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:22.365343 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2d7d4-0072-4479-b097-0a8afc1de58b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:22.366319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d7d4-0072-4479-b097-0a8afc1de58b None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=0561a97f1a4d4f469cb5c2103e2541f3) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:22.366768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d7d4-0072-4479-b097-0a8afc1de58b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:22.368459 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2d7d4-0072-4479-b097-0a8afc1de58b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:22.371042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:22.375908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43223f-a1e8-438c-8af2-a7b1efb5915a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:22.377796 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 339/683] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:22 2022] GET /identity/v3/role_assignments?user.id=0561a97f1a4d4f469cb5c2103e2541f3&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:22.420639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda551b5-19dc-4512-9597-56e580318f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:22.421422 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda551b5-19dc-4512-9597-56e580318f0a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:22.421802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda551b5-19dc-4512-9597-56e580318f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:22.422229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda551b5-19dc-4512-9597-56e580318f0a None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:22.423186 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda551b5-19dc-4512-9597-56e580318f0a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:22.423604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda551b5-19dc-4512-9597-56e580318f0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:22.425211 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda551b5-19dc-4512-9597-56e580318f0a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:22.447251 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 345/684] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Oct 3 14:39:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:22.452788 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d7d4-0072-4479-b097-0a8afc1de58b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:22.570304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2d7d4-0072-4479-b097-0a8afc1de58b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:22.611040 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e134728-66e1-4a31-9cd5-bd4a53596c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:22.611801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e134728-66e1-4a31-9cd5-bd4a53596c2c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:22.612182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e134728-66e1-4a31-9cd5-bd4a53596c2c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:22.612570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e134728-66e1-4a31-9cd5-bd4a53596c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:22.685495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:22.692669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e134728-66e1-4a31-9cd5-bd4a53596c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:22.694264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e134728-66e1-4a31-9cd5-bd4a53596c2c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:22.803735 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 340/685] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:22.813421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda551b5-19dc-4512-9597-56e580318f0a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:22.865688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:23.014385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda551b5-19dc-4512-9597-56e580318f0a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:23.088309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40cf1a-9034-4d89-839e-4c443c2dace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:23.089991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40cf1a-9034-4d89-839e-4c443c2dace3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:23.089991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40cf1a-9034-4d89-839e-4c443c2dace3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:23.090236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40cf1a-9034-4d89-839e-4c443c2dace3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:23.123157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40cf1a-9034-4d89-839e-4c443c2dace3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:23.125847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40cf1a-9034-4d89-839e-4c443c2dace3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-ff40cf1a-9034-4d89-839e-4c443c2dace3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:23.161927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:23.163993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:23.166113 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:23.166113 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:23.166113 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:23.166113 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 346/686] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:23.172940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e134728-66e1-4a31-9cd5-bd4a53596c2c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:23.173833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a3418-40d3-48ee-816a-e46dc7fda87b None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:23.174313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a3418-40d3-48ee-816a-e46dc7fda87b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:23.174791 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a3418-40d3-48ee-816a-e46dc7fda87b None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:23.177397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 347/687] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:23.184622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcf6cd-939f-4e19-b693-283322bfda4f None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:23.185403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcf6cd-939f-4e19-b693-283322bfda4f None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:23.186070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcf6cd-939f-4e19-b693-283322bfda4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:23.228674 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-c3bcf6cd-939f-4e19-b693-283322bfda4f None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:23.229952 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-c3bcf6cd-939f-4e19-b693-283322bfda4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:23.372521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e134728-66e1-4a31-9cd5-bd4a53596c2c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:23.374727 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:23.399243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 348/688] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:39:23.434512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87269ea4-42f8-400d-bae3-0f4bf43082c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:23.436008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87269ea4-42f8-400d-bae3-0f4bf43082c0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:23.436406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87269ea4-42f8-400d-bae3-0f4bf43082c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:23.436883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87269ea4-42f8-400d-bae3-0f4bf43082c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:23.437770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87269ea4-42f8-400d-bae3-0f4bf43082c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:23.438082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87269ea4-42f8-400d-bae3-0f4bf43082c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:23.439546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87269ea4-42f8-400d-bae3-0f4bf43082c0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:23.462609 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 341/689] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:23.468066 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcf6cd-939f-4e19-b693-283322bfda4f None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:23.472143 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:23.586920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcf6cd-939f-4e19-b693-283322bfda4f None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:23.644552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf98c2-cd2a-4ca3-9c50-90a96ee98393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:23.645838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf98c2-cd2a-4ca3-9c50-90a96ee98393 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:23.646475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf98c2-cd2a-4ca3-9c50-90a96ee98393 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:23.647172 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf98c2-cd2a-4ca3-9c50-90a96ee98393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:23.660516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf98c2-cd2a-4ca3-9c50-90a96ee98393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:23.662815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf98c2-cd2a-4ca3-9c50-90a96ee98393 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-1bcf98c2-cd2a-4ca3-9c50-90a96ee98393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:23.682320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:23.683493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:23.684574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:23.684574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:23.684574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:23.684574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:23.684574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:23.684574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:23.684574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:23.684574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:23.687176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 349/690] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:23.692690 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87269ea4-42f8-400d-bae3-0f4bf43082c0 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:23.727803 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf98c2-cd2a-4ca3-9c50-90a96ee98393 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:23.875476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:23.891917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87269ea4-42f8-400d-bae3-0f4bf43082c0 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:23.963792 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf98c2-cd2a-4ca3-9c50-90a96ee98393 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:23.974540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e3805-7c48-4764-9e31-3a75afbf5506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:23.975773 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e3805-7c48-4764-9e31-3a75afbf5506 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:23.976321 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e3805-7c48-4764-9e31-3a75afbf5506 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:23.976722 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e3805-7c48-4764-9e31-3a75afbf5506 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:23.977744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e3805-7c48-4764-9e31-3a75afbf5506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:23.978433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e3805-7c48-4764-9e31-3a75afbf5506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:23.980351 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e3805-7c48-4764-9e31-3a75afbf5506 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:23.999495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 342/691] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:24.009916 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e3805-7c48-4764-9e31-3a75afbf5506 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:24.030792 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be99a5e-8071-4ec6-b7de-b845442c40c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:24.032453 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be99a5e-8071-4ec6-b7de-b845442c40c8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:24.033529 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be99a5e-8071-4ec6-b7de-b845442c40c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:24.034087 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be99a5e-8071-4ec6-b7de-b845442c40c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:24.052124 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:24.062436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be99a5e-8071-4ec6-b7de-b845442c40c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-6be99a5e-8071-4ec6-b7de-b845442c40c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:24.067972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:24.069086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:24.070108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:24.086581 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 350/692] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:24.091726 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be99a5e-8071-4ec6-b7de-b845442c40c8 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:24.227710 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e3805-7c48-4764-9e31-3a75afbf5506 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:24.275326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ad90c-25f4-4797-8bf0-d3ff1022a459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:24.276308 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ad90c-25f4-4797-8bf0-d3ff1022a459 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:24.276779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ad90c-25f4-4797-8bf0-d3ff1022a459 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:24.277234 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ad90c-25f4-4797-8bf0-d3ff1022a459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:24.278585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ad90c-25f4-4797-8bf0-d3ff1022a459 None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=29b7487e76304a87bd9d07d1f63b01d3) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:24.279095 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ad90c-25f4-4797-8bf0-d3ff1022a459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:24.281744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ad90c-25f4-4797-8bf0-d3ff1022a459 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:24.300115 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 343/693] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:24 2022] GET /identity/v3/role_assignments?user.id=29b7487e76304a87bd9d07d1f63b01d3&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:24.315566 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be99a5e-8071-4ec6-b7de-b845442c40c8 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:24.361487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:24.384709 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbfbd6-7c32-4141-a862-c6b9dd6f5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:24.385351 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbfbd6-7c32-4141-a862-c6b9dd6f5821 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:24.385637 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbfbd6-7c32-4141-a862-c6b9dd6f5821 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:24.385911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbfbd6-7c32-4141-a862-c6b9dd6f5821 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:24.386593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbfbd6-7c32-4141-a862-c6b9dd6f5821 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:24.386896 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbfbd6-7c32-4141-a862-c6b9dd6f5821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:24.388423 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbfbd6-7c32-4141-a862-c6b9dd6f5821 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:24.410465 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 351/694] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:24.417992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ad90c-25f4-4797-8bf0-d3ff1022a459 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:24.578610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:24.607005 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ad90c-25f4-4797-8bf0-d3ff1022a459 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:24.661882 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b8edb-d42f-40ef-b6e0-14fe60d516e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:24.662542 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8edb-d42f-40ef-b6e0-14fe60d516e3 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:24.662821 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8edb-d42f-40ef-b6e0-14fe60d516e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:24.663119 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8edb-d42f-40ef-b6e0-14fe60d516e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:24.675966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b8edb-d42f-40ef-b6e0-14fe60d516e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:24.677414 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b8edb-d42f-40ef-b6e0-14fe60d516e3 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-dd9b8edb-d42f-40ef-b6e0-14fe60d516e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:24.698617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:24.700605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:24.702468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:24.702468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:24.702468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:24.702468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 344/695] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:24.708088 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbfbd6-7c32-4141-a862-c6b9dd6f5821 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:24.819735 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbfbd6-7c32-4141-a862-c6b9dd6f5821 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:24.856472 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0ab8a-df5b-4e55-aa7e-96b3d9c92229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:24.857716 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0ab8a-df5b-4e55-aa7e-96b3d9c92229 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:24.858000 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0ab8a-df5b-4e55-aa7e-96b3d9c92229 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:24.858290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0ab8a-df5b-4e55-aa7e-96b3d9c92229 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:24.858883 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0ab8a-df5b-4e55-aa7e-96b3d9c92229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:24.859213 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0ab8a-df5b-4e55-aa7e-96b3d9c92229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:24.860569 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0ab8a-df5b-4e55-aa7e-96b3d9c92229 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:24.875131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 352/696] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:24.878712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b8edb-d42f-40ef-b6e0-14fe60d516e3 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:24.991178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b8edb-d42f-40ef-b6e0-14fe60d516e3 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:25.030559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac566c11-492b-4fc0-95a0-be586468b5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:25.031235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac566c11-492b-4fc0-95a0-be586468b5c0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.031518 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac566c11-492b-4fc0-95a0-be586468b5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.031788 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac566c11-492b-4fc0-95a0-be586468b5c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.033834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:25.041163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac566c11-492b-4fc0-95a0-be586468b5c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:25.042935 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac566c11-492b-4fc0-95a0-be586468b5c0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-ac566c11-492b-4fc0-95a0-be586468b5c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:25.056424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:25.057473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:25.058408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 345/697] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Oct 3 14:39:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:25.065401 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0ab8a-df5b-4e55-aa7e-96b3d9c92229 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:25.125593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:25.209453 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0ab8a-df5b-4e55-aa7e-96b3d9c92229 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:25.236217 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b2c01-634c-42f8-8701-315cfb982a24 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.236860 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b2c01-634c-42f8-8701-315cfb982a24 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.237340 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b2c01-634c-42f8-8701-315cfb982a24 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.239238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 346/698] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:25.252953 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eaeee-178b-45e9-9fb8-1fc020ad4666 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.253256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eaeee-178b-45e9-9fb8-1fc020ad4666 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.253513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eaeee-178b-45e9-9fb8-1fc020ad4666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.255353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabad405-5bc5-4719-a40e-e1bcb05bcbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:25.255964 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabad405-5bc5-4719-a40e-e1bcb05bcbac None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.256241 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabad405-5bc5-4719-a40e-e1bcb05bcbac None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.256510 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabad405-5bc5-4719-a40e-e1bcb05bcbac None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.257293 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabad405-5bc5-4719-a40e-e1bcb05bcbac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:25.257602 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabad405-5bc5-4719-a40e-e1bcb05bcbac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:25.259027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabad405-5bc5-4719-a40e-e1bcb05bcbac None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:25.279277 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 353/699] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Oct 3 14:39:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:25.285578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabad405-5bc5-4719-a40e-e1bcb05bcbac None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:25.299990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-656eaeee-178b-45e9-9fb8-1fc020ad4666 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:25.301204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-656eaeee-178b-45e9-9fb8-1fc020ad4666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:25.391158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 347/700] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:25.392475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6530fe-6471-4d69-a468-eeaf2dea4e9f None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.393047 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6530fe-6471-4d69-a468-eeaf2dea4e9f None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.393338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6530fe-6471-4d69-a468-eeaf2dea4e9f None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.394927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 348/701] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:25.400515 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379342a-5fd2-4175-b30c-5a4a6ecab5b0 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.400706 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379342a-5fd2-4175-b30c-5a4a6ecab5b0 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.400936 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379342a-5fd2-4175-b30c-5a4a6ecab5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.425122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabad405-5bc5-4719-a40e-e1bcb05bcbac None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:25.428670 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:25.432581 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-1379342a-5fd2-4175-b30c-5a4a6ecab5b0 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:25.436758 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-1379342a-5fd2-4175-b30c-5a4a6ecab5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:25.467670 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b641-c363-4afb-8163-342a0ddefca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:25.468673 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b641-c363-4afb-8163-342a0ddefca5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.469164 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b641-c363-4afb-8163-342a0ddefca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.469807 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937b641-c363-4afb-8163-342a0ddefca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.535300 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 349/702] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:25.536646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b11e-01c5-4350-88e5-44415d1f6916 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.537127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b11e-01c5-4350-88e5-44415d1f6916 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.537244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b11e-01c5-4350-88e5-44415d1f6916 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.538679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 350/703] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:25.544678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066465b-dccd-4989-bd05-362b29f19838 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.545029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066465b-dccd-4989-bd05-362b29f19838 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.545512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066465b-dccd-4989-bd05-362b29f19838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.548785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b641-c363-4afb-8163-342a0ddefca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:25.551532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937b641-c363-4afb-8163-342a0ddefca5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:25.588111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-9066465b-dccd-4989-bd05-362b29f19838 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:25.589122 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-9066465b-dccd-4989-bd05-362b29f19838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:25.662504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 354/704] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:25.668322 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b641-c363-4afb-8163-342a0ddefca5 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:25.671730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:25.705007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:25.727629 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 351/705] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:25.728382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066465b-dccd-4989-bd05-362b29f19838 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:25.790083 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937b641-c363-4afb-8163-342a0ddefca5 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:25.827507 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d935ee-5147-4262-96e4-1b83ed607d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:25.828498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d935ee-5147-4262-96e4-1b83ed607d20 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.829037 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d935ee-5147-4262-96e4-1b83ed607d20 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.829515 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d935ee-5147-4262-96e4-1b83ed607d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.842236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d935ee-5147-4262-96e4-1b83ed607d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:25.844172 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d935ee-5147-4262-96e4-1b83ed607d20 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-d5d935ee-5147-4262-96e4-1b83ed607d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:25.860832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:25.861871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:25.862765 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:25.862765 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:25.862765 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:25.866461 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 355/706] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:25.872919 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d935ee-5147-4262-96e4-1b83ed607d20 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:25.917239 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066465b-dccd-4989-bd05-362b29f19838 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:25.959265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:25.974130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e1ff-2b38-4b2d-a3ac-7c6df2d475a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:25.975573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e1ff-2b38-4b2d-a3ac-7c6df2d475a6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:25.976379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e1ff-2b38-4b2d-a3ac-7c6df2d475a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:25.976869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e1ff-2b38-4b2d-a3ac-7c6df2d475a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:25.987702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d935ee-5147-4262-96e4-1b83ed607d20 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:25.992303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e1ff-2b38-4b2d-a3ac-7c6df2d475a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:25.993966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e1ff-2b38-4b2d-a3ac-7c6df2d475a6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-30d7e1ff-2b38-4b2d-a3ac-7c6df2d475a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:26.015881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:26.016879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:26.017766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:26.017766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:26.017766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:26.020299 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 352/707] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:26.025472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e1ff-2b38-4b2d-a3ac-7c6df2d475a6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.035465 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de46618-04ce-4835-9e1a-9e58f774342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.036778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de46618-04ce-4835-9e1a-9e58f774342e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.037713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de46618-04ce-4835-9e1a-9e58f774342e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.038454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de46618-04ce-4835-9e1a-9e58f774342e None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.039459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de46618-04ce-4835-9e1a-9e58f774342e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:26.040189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de46618-04ce-4835-9e1a-9e58f774342e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.042527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de46618-04ce-4835-9e1a-9e58f774342e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.065554 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.065736 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 356/708] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:26.065736 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de46618-04ce-4835-9e1a-9e58f774342e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.139821 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e1ff-2b38-4b2d-a3ac-7c6df2d475a6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:26.173195 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de46618-04ce-4835-9e1a-9e58f774342e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:26.177425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b2dce-9801-4c98-b705-447d25c60f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.178065 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2dce-9801-4c98-b705-447d25c60f9d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.178342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2dce-9801-4c98-b705-447d25c60f9d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.178613 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2dce-9801-4c98-b705-447d25c60f9d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.179228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b2dce-9801-4c98-b705-447d25c60f9d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.180750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b2dce-9801-4c98-b705-447d25c60f9d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.190421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-6a8b2dce-9801-4c98-b705-447d25c60f9d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:26.192004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:26.193157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:26.194007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 353/709] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:26.194808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b2dce-9801-4c98-b705-447d25c60f9d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.215547 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984af40-1be6-45e5-b856-bb582557e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.216353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984af40-1be6-45e5-b856-bb582557e4fb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.216696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984af40-1be6-45e5-b856-bb582557e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.216987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984af40-1be6-45e5-b856-bb582557e4fb None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.217530 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984af40-1be6-45e5-b856-bb582557e4fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:26.217827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984af40-1be6-45e5-b856-bb582557e4fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.219194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984af40-1be6-45e5-b856-bb582557e4fb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.230546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 357/710] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:26.231375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984af40-1be6-45e5-b856-bb582557e4fb None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.302673 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.305873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b2dce-9801-4c98-b705-447d25c60f9d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:26.345139 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984af40-1be6-45e5-b856-bb582557e4fb None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:26.348048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f7b84-f214-4564-a721-36e62d0cfe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.348048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f7b84-f214-4564-a721-36e62d0cfe1d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.348362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f7b84-f214-4564-a721-36e62d0cfe1d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.348577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f7b84-f214-4564-a721-36e62d0cfe1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.355472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f7b84-f214-4564-a721-36e62d0cfe1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.357204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f7b84-f214-4564-a721-36e62d0cfe1d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-777f7b84-f214-4564-a721-36e62d0cfe1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:26.368160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:26.369021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 354/711] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:26.369944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f7b84-f214-4564-a721-36e62d0cfe1d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.387485 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42352379-0be9-4197-a119-42ba6314023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.388155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42352379-0be9-4197-a119-42ba6314023c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.388543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42352379-0be9-4197-a119-42ba6314023c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.388814 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42352379-0be9-4197-a119-42ba6314023c None admin] PATH_INFO: `/v3/services/network` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.389496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42352379-0be9-4197-a119-42ba6314023c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.390829 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42352379-0be9-4197-a119-42ba6314023c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-42352379-0be9-4197-a119-42ba6314023c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:26.402541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:26.404185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:26.405063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 358/712] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:26.406418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42352379-0be9-4197-a119-42ba6314023c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.449018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.473164 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f7b84-f214-4564-a721-36e62d0cfe1d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:26.509445 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a10109-99d3-4c8b-831d-9c7d20cc27ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.510068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a10109-99d3-4c8b-831d-9c7d20cc27ce None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.510350 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a10109-99d3-4c8b-831d-9c7d20cc27ce None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.510629 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a10109-99d3-4c8b-831d-9c7d20cc27ce None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.511289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a10109-99d3-4c8b-831d-9c7d20cc27ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:26.511605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a10109-99d3-4c8b-831d-9c7d20cc27ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.513526 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a10109-99d3-4c8b-831d-9c7d20cc27ce None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.514787 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42352379-0be9-4197-a119-42ba6314023c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:26.522381 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 355/713] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:26.522381 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a10109-99d3-4c8b-831d-9c7d20cc27ce None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.543636 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.558805 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd96dd-4b44-45da-ad51-345f7bb1f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.560175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd96dd-4b44-45da-ad51-345f7bb1f386 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.560685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd96dd-4b44-45da-ad51-345f7bb1f386 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.561194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd96dd-4b44-45da-ad51-345f7bb1f386 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.561969 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd96dd-4b44-45da-ad51-345f7bb1f386 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.563574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd96dd-4b44-45da-ad51-345f7bb1f386 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.586608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 359/714] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:39:26 2022] POST /identity/v3/users => generated 254 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:26.587457 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd96dd-4b44-45da-ad51-345f7bb1f386 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.648356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a10109-99d3-4c8b-831d-9c7d20cc27ce None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:26.693834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d09b-ca37-48a0-aa7b-e68d263628c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.694747 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d09b-ca37-48a0-aa7b-e68d263628c6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.695250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d09b-ca37-48a0-aa7b-e68d263628c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.695675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d09b-ca37-48a0-aa7b-e68d263628c6 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.696661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d09b-ca37-48a0-aa7b-e68d263628c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:26.697124 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d09b-ca37-48a0-aa7b-e68d263628c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.699138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107d09b-ca37-48a0-aa7b-e68d263628c6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.719153 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 356/715] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:26.720165 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d09b-ca37-48a0-aa7b-e68d263628c6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.748794 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.760536 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd96dd-4b44-45da-ad51-345f7bb1f386 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:26.811441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44d4c0-68b7-4630-9e33-e70b1c682cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.813339 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d4c0-68b7-4630-9e33-e70b1c682cce None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.813339 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d4c0-68b7-4630-9e33-e70b1c682cce None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.813339 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d4c0-68b7-4630-9e33-e70b1c682cce None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.813985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44d4c0-68b7-4630-9e33-e70b1c682cce None admin] RBAC: Adding query filter params (name=network) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:26.814290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44d4c0-68b7-4630-9e33-e70b1c682cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.816321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44d4c0-68b7-4630-9e33-e70b1c682cce None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.821147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 360/716] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:26.822236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44d4c0-68b7-4630-9e33-e70b1c682cce None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:26.838140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:26.856690 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107d09b-ca37-48a0-aa7b-e68d263628c6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:26.895324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa228c2-5589-427f-8a93-d5d89fb46512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:26.896123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa228c2-5589-427f-8a93-d5d89fb46512 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:26.896497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa228c2-5589-427f-8a93-d5d89fb46512 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:26.896872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa228c2-5589-427f-8a93-d5d89fb46512 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:26.897606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa228c2-5589-427f-8a93-d5d89fb46512 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:26.898010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa228c2-5589-427f-8a93-d5d89fb46512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:26.899494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa228c2-5589-427f-8a93-d5d89fb46512 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:26.905797 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 357/717] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:26.906781 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa228c2-5589-427f-8a93-d5d89fb46512 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:27.001925 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44d4c0-68b7-4630-9e33-e70b1c682cce None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:27.066922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de36fce-abff-49c2-a33e-037c80802945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:27.067756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de36fce-abff-49c2-a33e-037c80802945 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:27.068134 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de36fce-abff-49c2-a33e-037c80802945 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:27.068501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de36fce-abff-49c2-a33e-037c80802945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:27.069335 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de36fce-abff-49c2-a33e-037c80802945 None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=bfb0254e89514ff18e1c91dc427e4b1e) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:27.069747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de36fce-abff-49c2-a33e-037c80802945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:27.078975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de36fce-abff-49c2-a33e-037c80802945 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:27.078975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 361/718] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/role_assignments?user.id=bfb0254e89514ff18e1c91dc427e4b1e&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:27.089889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa228c2-5589-427f-8a93-d5d89fb46512 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:27.134669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fa258-9445-4f09-8f6d-0d04215b910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:27.135516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa258-9445-4f09-8f6d-0d04215b910d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:27.136116 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa258-9445-4f09-8f6d-0d04215b910d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:27.136487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fa258-9445-4f09-8f6d-0d04215b910d None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:27.137320 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa258-9445-4f09-8f6d-0d04215b910d None admin] RBAC: Adding query filter params (type=network) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:27.137729 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa258-9445-4f09-8f6d-0d04215b910d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:27.140031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fa258-9445-4f09-8f6d-0d04215b910d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:27.146037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 358/719] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:39:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:27.255860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b57b-1d83-40d4-a43f-789d0a9a8801 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:27.256272 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b57b-1d83-40d4-a43f-789d0a9a8801 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:27.256642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b57b-1d83-40d4-a43f-789d0a9a8801 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:27.258294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 362/720] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:27.264560 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b33c3f-a671-4abc-b3ea-dcc3e61e0ed4 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:27.265018 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b33c3f-a671-4abc-b3ea-dcc3e61e0ed4 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:27.265407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b33c3f-a671-4abc-b3ea-dcc3e61e0ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:27.288476 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a3b33c3f-a671-4abc-b3ea-dcc3e61e0ed4 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:27.289861 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a3b33c3f-a671-4abc-b3ea-dcc3e61e0ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:27.301316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:27.381954 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 359/721] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:27.708781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b57b-1d83-40d4-a43f-789d0a9a8801 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:27.745946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:27.840175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b57b-1d83-40d4-a43f-789d0a9a8801 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:27.882370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a285d-6cf1-4dea-8915-3b466ca99de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:27.883043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a285d-6cf1-4dea-8915-3b466ca99de3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:27.883328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a285d-6cf1-4dea-8915-3b466ca99de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:27.883603 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a285d-6cf1-4dea-8915-3b466ca99de3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:27.897137 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a285d-6cf1-4dea-8915-3b466ca99de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-ec6a285d-6cf1-4dea-8915-3b466ca99de3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:27.902166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:27.903194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:27.904996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 363/722] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:27.910080 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b33c3f-a671-4abc-b3ea-dcc3e61e0ed4 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:28.020143 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b33c3f-a671-4abc-b3ea-dcc3e61e0ed4 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:28.056232 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a4eb2-b3dc-416a-800b-35cf640aede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:28.056846 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a4eb2-b3dc-416a-800b-35cf640aede0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:28.057131 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a4eb2-b3dc-416a-800b-35cf640aede0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:28.057408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a4eb2-b3dc-416a-800b-35cf640aede0 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:28.058069 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a4eb2-b3dc-416a-800b-35cf640aede0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:28.058375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a4eb2-b3dc-416a-800b-35cf640aede0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:28.060435 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a4eb2-b3dc-416a-800b-35cf640aede0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:28.069029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 360/723] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:28.074829 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a285d-6cf1-4dea-8915-3b466ca99de3 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:28.175473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:28.209764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a285d-6cf1-4dea-8915-3b466ca99de3 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:28.252912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d36de-b97f-4f2b-bf60-50667d7c284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:28.253919 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d36de-b97f-4f2b-bf60-50667d7c284f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:28.254406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d36de-b97f-4f2b-bf60-50667d7c284f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:28.254903 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d36de-b97f-4f2b-bf60-50667d7c284f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:28.266033 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d36de-b97f-4f2b-bf60-50667d7c284f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:28.267857 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d36de-b97f-4f2b-bf60-50667d7c284f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-459d36de-b97f-4f2b-bf60-50667d7c284f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:28.283558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:28.284578 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:28.285475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:28.285475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:28.285475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:28.287867 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 364/724] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:28.293597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a4eb2-b3dc-416a-800b-35cf640aede0 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:28.299212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:28.402800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a4eb2-b3dc-416a-800b-35cf640aede0 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:28.439503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091883a4-2366-4eaf-be04-e60e6d1bdec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:28.440469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091883a4-2366-4eaf-be04-e60e6d1bdec6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:28.440994 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091883a4-2366-4eaf-be04-e60e6d1bdec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:28.441480 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091883a4-2366-4eaf-be04-e60e6d1bdec6 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:28.442379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091883a4-2366-4eaf-be04-e60e6d1bdec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:28.442913 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091883a4-2366-4eaf-be04-e60e6d1bdec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:28.444565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091883a4-2366-4eaf-be04-e60e6d1bdec6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:28.457805 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 361/725] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:28.463493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d36de-b97f-4f2b-bf60-50667d7c284f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:28.571508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d36de-b97f-4f2b-bf60-50667d7c284f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:28.609918 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf69877-9163-4180-b264-caca70fb1fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:28.610549 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69877-9163-4180-b264-caca70fb1fa3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:28.610832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69877-9163-4180-b264-caca70fb1fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:28.611121 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf69877-9163-4180-b264-caca70fb1fa3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:28.613900 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:28.624875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf69877-9163-4180-b264-caca70fb1fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:28.626297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf69877-9163-4180-b264-caca70fb1fa3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-4cf69877-9163-4180-b264-caca70fb1fa3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:28.637783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:28.638822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:28.639833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 365/726] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:28.647503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091883a4-2366-4eaf-be04-e60e6d1bdec6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:28.773093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:28.829856 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091883a4-2366-4eaf-be04-e60e6d1bdec6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:28.877996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75f4b5-e2d2-4ceb-ba1d-64a7dd71179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:28.878611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75f4b5-e2d2-4ceb-ba1d-64a7dd71179b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:28.878888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75f4b5-e2d2-4ceb-ba1d-64a7dd71179b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:28.879234 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75f4b5-e2d2-4ceb-ba1d-64a7dd71179b None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:28.879966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75f4b5-e2d2-4ceb-ba1d-64a7dd71179b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:28.880272 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75f4b5-e2d2-4ceb-ba1d-64a7dd71179b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:28.881676 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75f4b5-e2d2-4ceb-ba1d-64a7dd71179b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:28.906940 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 362/727] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Oct 3 14:39:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:28.912424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf69877-9163-4180-b264-caca70fb1fa3 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:29.041115 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf69877-9163-4180-b264-caca70fb1fa3 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:29.082058 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa94102-4bca-45a8-b14e-5c540a8509c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:29.082663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa94102-4bca-45a8-b14e-5c540a8509c0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:29.082934 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa94102-4bca-45a8-b14e-5c540a8509c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:29.083144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa94102-4bca-45a8-b14e-5c540a8509c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:29.171338 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:29.175993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa94102-4bca-45a8-b14e-5c540a8509c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:29.177464 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa94102-4bca-45a8-b14e-5c540a8509c0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:29.280861 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 366/728] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 14:39:29.286419 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75f4b5-e2d2-4ceb-ba1d-64a7dd71179b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:29.446666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71438d07-f41f-4078-8024-e39af41e1906 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:29.447108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71438d07-f41f-4078-8024-e39af41e1906 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:29.447314 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71438d07-f41f-4078-8024-e39af41e1906 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:29.448692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 367/729] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:29.449237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75f4b5-e2d2-4ceb-ba1d-64a7dd71179b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:29.454273 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d005-08d1-4f90-ab86-0429fb3fa92d None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:29.454895 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d005-08d1-4f90-ab86-0429fb3fa92d None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:29.455402 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d005-08d1-4f90-ab86-0429fb3fa92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:29.484927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-9c77d005-08d1-4f90-ab86-0429fb3fa92d None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:29.486100 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-9c77d005-08d1-4f90-ab86-0429fb3fa92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:29.499305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:29.517222 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302ccfe-5686-45e1-b34e-2e8e2ceb03fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:29.517866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302ccfe-5686-45e1-b34e-2e8e2ceb03fa None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:29.518139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302ccfe-5686-45e1-b34e-2e8e2ceb03fa None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:29.518408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302ccfe-5686-45e1-b34e-2e8e2ceb03fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:29.534695 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302ccfe-5686-45e1-b34e-2e8e2ceb03fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:29.536170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302ccfe-5686-45e1-b34e-2e8e2ceb03fa None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e302ccfe-5686-45e1-b34e-2e8e2ceb03fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:29.565366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:29.566393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:29.568215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:29.568215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:29.568215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:29.568215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 363/730] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:29.576393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302ccfe-5686-45e1-b34e-2e8e2ceb03fa None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:29.581529 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 368/731] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 14:39:29.732009 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302ccfe-5686-45e1-b34e-2e8e2ceb03fa None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:29.793203 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac618f-345f-4f8a-aea0-7eb31a848cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:29.793817 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac618f-345f-4f8a-aea0-7eb31a848cb0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:29.794636 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac618f-345f-4f8a-aea0-7eb31a848cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:29.794910 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac618f-345f-4f8a-aea0-7eb31a848cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:29.795572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac618f-345f-4f8a-aea0-7eb31a848cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:29.795870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac618f-345f-4f8a-aea0-7eb31a848cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:29.797227 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac618f-345f-4f8a-aea0-7eb31a848cb0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:29.814992 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d582-b3e3-461b-903a-28a80c2a293b None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:29.815332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d582-b3e3-461b-903a-28a80c2a293b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:29.815546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95d582-b3e3-461b-903a-28a80c2a293b None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:29.817042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 369/732] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:29.817529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 364/733] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:29.822147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e7d45-ed54-44a9-beac-455d793a1c54 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:29.822433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e7d45-ed54-44a9-beac-455d793a1c54 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:29.822707 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e7d45-ed54-44a9-beac-455d793a1c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:29.822818 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac618f-345f-4f8a-aea0-7eb31a848cb0 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:29.851350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-b55e7d45-ed54-44a9-beac-455d793a1c54 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:29.852908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-b55e7d45-ed54-44a9-beac-455d793a1c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:29.864237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:29.892251 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:29.956921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 370/734] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:29.958192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5623a-5ab8-4a8a-b0e2-09b935ee263f None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:29.958476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5623a-5ab8-4a8a-b0e2-09b935ee263f None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:29.958749 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5623a-5ab8-4a8a-b0e2-09b935ee263f None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:29.960218 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 371/735] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:29.965163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac618f-345f-4f8a-aea0-7eb31a848cb0 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:29.968153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5623a-5ab8-4a8a-b0e2-09b935ee263f None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:30.003432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06182c-8e63-485a-8c7f-0b5bd96826a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:30.004422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06182c-8e63-485a-8c7f-0b5bd96826a6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.004931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06182c-8e63-485a-8c7f-0b5bd96826a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.005419 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06182c-8e63-485a-8c7f-0b5bd96826a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.013538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06182c-8e63-485a-8c7f-0b5bd96826a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:30.015457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06182c-8e63-485a-8c7f-0b5bd96826a6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-0f06182c-8e63-485a-8c7f-0b5bd96826a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:30.027319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:30.028233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:30.030384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:30.030384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:30.030384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:30.030384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:30.030384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:30.030384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:30.030384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:30.030384 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:30.035000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 365/736] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:30.036922 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e35c8-3b74-4a79-b302-2e861859e008 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.037646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e35c8-3b74-4a79-b302-2e861859e008 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.038193 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e35c8-3b74-4a79-b302-2e861859e008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.061605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-da1e35c8-3b74-4a79-b302-2e861859e008 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:30.063333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-da1e35c8-3b74-4a79-b302-2e861859e008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:30.112016 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5623a-5ab8-4a8a-b0e2-09b935ee263f None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:30.154539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 366/737] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:30.155295 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8cc30-817c-4261-b4be-df5f54c1b3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:30.155945 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8cc30-817c-4261-b4be-df5f54c1b3ac None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.156228 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8cc30-817c-4261-b4be-df5f54c1b3ac None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.156508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8cc30-817c-4261-b4be-df5f54c1b3ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.156613 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e35c8-3b74-4a79-b302-2e861859e008 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:30.167616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8cc30-817c-4261-b4be-df5f54c1b3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-58a8cc30-817c-4261-b4be-df5f54c1b3ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:30.172985 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:30.173971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:30.174827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 372/738] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:30.179996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9b8cd-85f6-447f-854a-1f9e76439801 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.180278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9b8cd-85f6-447f-854a-1f9e76439801 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.180550 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9b8cd-85f6-447f-854a-1f9e76439801 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.182877 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 373/739] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:30.183461 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9b8cd-85f6-447f-854a-1f9e76439801 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:30.197039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:30.208864 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:30.292742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e35c8-3b74-4a79-b302-2e861859e008 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:30.316860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9b8cd-85f6-447f-854a-1f9e76439801 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:30.329369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ec93c-a30b-46dc-a85f-5e7359d348c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:30.329985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec93c-a30b-46dc-a85f-5e7359d348c5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.330262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec93c-a30b-46dc-a85f-5e7359d348c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.330538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ec93c-a30b-46dc-a85f-5e7359d348c5 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.331325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ec93c-a30b-46dc-a85f-5e7359d348c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:30.331630 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ec93c-a30b-46dc-a85f-5e7359d348c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:30.333139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ec93c-a30b-46dc-a85f-5e7359d348c5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:30.349955 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 367/740] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:30.351097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9298061-d750-4c9b-88df-ba19dfb0fea2 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.351393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9298061-d750-4c9b-88df-ba19dfb0fea2 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.351673 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9298061-d750-4c9b-88df-ba19dfb0fea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.353769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90f0a-c1eb-4149-8136-d55ccf8f1c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:30.354374 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90f0a-c1eb-4149-8136-d55ccf8f1c27 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.354652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90f0a-c1eb-4149-8136-d55ccf8f1c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.354923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90f0a-c1eb-4149-8136-d55ccf8f1c27 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.355596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90f0a-c1eb-4149-8136-d55ccf8f1c27 None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:30.355896 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90f0a-c1eb-4149-8136-d55ccf8f1c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:30.357262 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90f0a-c1eb-4149-8136-d55ccf8f1c27 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:30.365571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 374/741] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:30.366181 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90f0a-c1eb-4149-8136-d55ccf8f1c27 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:30.375018 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a9298061-d750-4c9b-88df-ba19dfb0fea2 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:30.376204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a9298061-d750-4c9b-88df-ba19dfb0fea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:30.445854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 368/742] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 14:39:30.446685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9298061-d750-4c9b-88df-ba19dfb0fea2 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:30.452628 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:30.461591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:30.479499 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90f0a-c1eb-4149-8136-d55ccf8f1c27 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:30.519044 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90be4e-4944-41d6-924a-8f6fdaf70291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:30.519651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90be4e-4944-41d6-924a-8f6fdaf70291 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.519935 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90be4e-4944-41d6-924a-8f6fdaf70291 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.520207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90be4e-4944-41d6-924a-8f6fdaf70291 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.520849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90be4e-4944-41d6-924a-8f6fdaf70291 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:30.522814 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90be4e-4944-41d6-924a-8f6fdaf70291 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:30.547069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 375/743] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:39:30 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:30.547069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90be4e-4944-41d6-924a-8f6fdaf70291 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:30.550894 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9298061-d750-4c9b-88df-ba19dfb0fea2 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:30.600032 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb06a3-5afa-4347-b13a-e87a124517f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:30.600941 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb06a3-5afa-4347-b13a-e87a124517f3 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.601364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb06a3-5afa-4347-b13a-e87a124517f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.601778 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb06a3-5afa-4347-b13a-e87a124517f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.602820 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb06a3-5afa-4347-b13a-e87a124517f3 None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=29b7487e76304a87bd9d07d1f63b01d3) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:30.603413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb06a3-5afa-4347-b13a-e87a124517f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:30.605037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb06a3-5afa-4347-b13a-e87a124517f3 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:30.612612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 369/744] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:30 2022] GET /identity/v3/role_assignments?user.id=29b7487e76304a87bd9d07d1f63b01d3&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:30.613822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb06a3-5afa-4347-b13a-e87a124517f3 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:30.708197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90be4e-4944-41d6-924a-8f6fdaf70291 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:30.722540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:30.760780 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb06a3-5afa-4347-b13a-e87a124517f3 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:30.765679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee7bd-0da6-44f4-a96a-85f26830d6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:30.766674 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee7bd-0da6-44f4-a96a-85f26830d6a7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.767228 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee7bd-0da6-44f4-a96a-85f26830d6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.767706 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee7bd-0da6-44f4-a96a-85f26830d6a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.775991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:30.783758 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdee7bd-0da6-44f4-a96a-85f26830d6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:30.786594 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdee7bd-0da6-44f4-a96a-85f26830d6a7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-ffdee7bd-0da6-44f4-a96a-85f26830d6a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:30.805648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:30.806656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:30.807593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:30.807593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:30.807593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:30.807593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 376/745] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:30.807593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee7bd-0da6-44f4-a96a-85f26830d6a7 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:30.820457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583dc1e-32ec-4d42-ba65-e2d6d7e1a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:30.822061 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583dc1e-32ec-4d42-ba65-e2d6d7e1a6da None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.822337 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583dc1e-32ec-4d42-ba65-e2d6d7e1a6da None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.823041 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583dc1e-32ec-4d42-ba65-e2d6d7e1a6da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.837614 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583dc1e-32ec-4d42-ba65-e2d6d7e1a6da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-6583dc1e-32ec-4d42-ba65-e2d6d7e1a6da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:30.846250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:30.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:30.848151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 370/746] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:30.848898 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583dc1e-32ec-4d42-ba65-e2d6d7e1a6da None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:30.935633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee7bd-0da6-44f4-a96a-85f26830d6a7 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:30.980436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565fbb1-c947-4387-91c1-af1269c57360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:30.981319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565fbb1-c947-4387-91c1-af1269c57360 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:30.981717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565fbb1-c947-4387-91c1-af1269c57360 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:30.982203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565fbb1-c947-4387-91c1-af1269c57360 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:30.982868 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565fbb1-c947-4387-91c1-af1269c57360 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:30.984982 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565fbb1-c947-4387-91c1-af1269c57360 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:30.993335 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583dc1e-32ec-4d42-ba65-e2d6d7e1a6da None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:31.005394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 377/747] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:39:30 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:31.006374 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565fbb1-c947-4387-91c1-af1269c57360 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:31.067546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:31.076656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:31.080609 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b321464-6e6c-4d95-af1c-23e239ff6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:31.081258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b321464-6e6c-4d95-af1c-23e239ff6776 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:31.081559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b321464-6e6c-4d95-af1c-23e239ff6776 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:31.081881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b321464-6e6c-4d95-af1c-23e239ff6776 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:31.082542 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b321464-6e6c-4d95-af1c-23e239ff6776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:31.084327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b321464-6e6c-4d95-af1c-23e239ff6776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:31.091308 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b321464-6e6c-4d95-af1c-23e239ff6776 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:31.121147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 371/748] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:31.127588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b321464-6e6c-4d95-af1c-23e239ff6776 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:31.140060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565fbb1-c947-4387-91c1-af1269c57360 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:31.188759 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483e275-cb38-4440-a5f8-4fb508896033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:31.189147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483e275-cb38-4440-a5f8-4fb508896033 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:31.189418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483e275-cb38-4440-a5f8-4fb508896033 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:31.189686 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483e275-cb38-4440-a5f8-4fb508896033 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:31.190347 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483e275-cb38-4440-a5f8-4fb508896033 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:31.191719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483e275-cb38-4440-a5f8-4fb508896033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:31.192024 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483e275-cb38-4440-a5f8-4fb508896033 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:31.202527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 378/749] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:31.208203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483e275-cb38-4440-a5f8-4fb508896033 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:31.280367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b321464-6e6c-4d95-af1c-23e239ff6776 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:31.330121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1bdc7-6cb4-462f-802c-7d9fbc59c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:31.330767 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1bdc7-6cb4-462f-802c-7d9fbc59c309 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:31.331043 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1bdc7-6cb4-462f-802c-7d9fbc59c309 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:31.331349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1bdc7-6cb4-462f-802c-7d9fbc59c309 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:31.339552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1bdc7-6cb4-462f-802c-7d9fbc59c309 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:31.341756 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1bdc7-6cb4-462f-802c-7d9fbc59c309 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:31.352848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483e275-cb38-4440-a5f8-4fb508896033 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-32d1bdc7-6cb4-462f-802c-7d9fbc59c309 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:31.354427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:31.356546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:31.359056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 372/750] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:39:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:31.367005 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1bdc7-6cb4-462f-802c-7d9fbc59c309 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:31.367260 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:31.391837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62156fe-8169-4168-a37f-d2668f97530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:31.392471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62156fe-8169-4168-a37f-d2668f97530e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:31.392752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62156fe-8169-4168-a37f-d2668f97530e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:31.393026 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62156fe-8169-4168-a37f-d2668f97530e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:31.405639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62156fe-8169-4168-a37f-d2668f97530e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:31.407116 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62156fe-8169-4168-a37f-d2668f97530e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:31.416777 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-c62156fe-8169-4168-a37f-d2668f97530e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:31.424944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:31.426923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:31.428145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:31.428145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:31.428145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:31.428145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 379/751] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:31.433765 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62156fe-8169-4168-a37f-d2668f97530e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:31.473036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1bdc7-6cb4-462f-802c-7d9fbc59c309 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:31.508612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6b5c8-f147-4e3f-81d3-9d6feeb6aeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:31.509223 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6b5c8-f147-4e3f-81d3-9d6feeb6aeac None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:31.509502 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6b5c8-f147-4e3f-81d3-9d6feeb6aeac None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:31.509772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6b5c8-f147-4e3f-81d3-9d6feeb6aeac None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:31.510496 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6b5c8-f147-4e3f-81d3-9d6feeb6aeac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:31.510801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6b5c8-f147-4e3f-81d3-9d6feeb6aeac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:31.518195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6b5c8-f147-4e3f-81d3-9d6feeb6aeac None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:31.546771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 373/752] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Oct 3 14:39:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:31.549586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62156fe-8169-4168-a37f-d2668f97530e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:31.552260 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6b5c8-f147-4e3f-81d3-9d6feeb6aeac None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:31.585410 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b881853-8235-4da0-a316-4bb09d62660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:31.586024 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b881853-8235-4da0-a316-4bb09d62660a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:31.586302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b881853-8235-4da0-a316-4bb09d62660a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:31.586575 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b881853-8235-4da0-a316-4bb09d62660a None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:31.587245 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b881853-8235-4da0-a316-4bb09d62660a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:31.587547 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b881853-8235-4da0-a316-4bb09d62660a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:31.588896 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b881853-8235-4da0-a316-4bb09d62660a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:31.602096 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 380/753] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:31.607564 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b881853-8235-4da0-a316-4bb09d62660a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:31.651498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:31.741264 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b881853-8235-4da0-a316-4bb09d62660a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:31.789784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6b5c8-f147-4e3f-81d3-9d6feeb6aeac None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:31.792960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63f97a-7e32-42da-b818-23d398353f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:31.793594 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63f97a-7e32-42da-b818-23d398353f7f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:31.793910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63f97a-7e32-42da-b818-23d398353f7f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:31.794188 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63f97a-7e32-42da-b818-23d398353f7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:31.803786 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:31.816066 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63f97a-7e32-42da-b818-23d398353f7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:31.817519 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63f97a-7e32-42da-b818-23d398353f7f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:31.835118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c937be-b0e4-4d14-b9b9-baeb849945ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:31.835977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c937be-b0e4-4d14-b9b9-baeb849945ea None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:31.836203 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c937be-b0e4-4d14-b9b9-baeb849945ea None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:31.836477 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c937be-b0e4-4d14-b9b9-baeb849945ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-3f63f97a-7e32-42da-b818-23d398353f7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:31.840406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:31.841958 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:31.843107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:31.847382 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 381/754] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Oct 3 14:39:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:31.852614 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63f97a-7e32-42da-b818-23d398353f7f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:31.935977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c937be-b0e4-4d14-b9b9-baeb849945ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:31.937426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c937be-b0e4-4d14-b9b9-baeb849945ea None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:31.986989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:32.007777 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63f97a-7e32-42da-b818-23d398353f7f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:32.055920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5e86-0ab5-4ee1-8ec6-448b9c351dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:32.056989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5e86-0ab5-4ee1-8ec6-448b9c351dfd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:32.057468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5e86-0ab5-4ee1-8ec6-448b9c351dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:32.057936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5e86-0ab5-4ee1-8ec6-448b9c351dfd None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:32.058865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e5e86-0ab5-4ee1-8ec6-448b9c351dfd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:32.059415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e5e86-0ab5-4ee1-8ec6-448b9c351dfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:32.061360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e5e86-0ab5-4ee1-8ec6-448b9c351dfd None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:32.099871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 382/755] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Oct 3 14:39:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:32.106032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5e86-0ab5-4ee1-8ec6-448b9c351dfd None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:32.248693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 374/756] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 14:39:32.254836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c937be-b0e4-4d14-b9b9-baeb849945ea None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:32.269465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:32.295081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5e86-0ab5-4ee1-8ec6-448b9c351dfd None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:32.362704 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d441f-2446-4236-91d3-b57fc53788c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:32.363295 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d441f-2446-4236-91d3-b57fc53788c3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:32.363576 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d441f-2446-4236-91d3-b57fc53788c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:32.363851 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d441f-2446-4236-91d3-b57fc53788c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:32.385264 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d441f-2446-4236-91d3-b57fc53788c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:32.386722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d441f-2446-4236-91d3-b57fc53788c3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:32.403801 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-a18d441f-2446-4236-91d3-b57fc53788c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:32.417147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:32.418141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:32.419705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:32.419705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:32.419705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:32.419705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 383/757] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:32.424295 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d441f-2446-4236-91d3-b57fc53788c3 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:32.448208 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c937be-b0e4-4d14-b9b9-baeb849945ea None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:32.524546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c5e0a-9968-41da-9ff4-720357c2df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:32.525187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c5e0a-9968-41da-9ff4-720357c2df68 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:32.525465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c5e0a-9968-41da-9ff4-720357c2df68 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:32.525741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c5e0a-9968-41da-9ff4-720357c2df68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:32.545288 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c5e0a-9968-41da-9ff4-720357c2df68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:32.546726 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c5e0a-9968-41da-9ff4-720357c2df68 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-a23c5e0a-9968-41da-9ff4-720357c2df68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:32.568971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:32.569991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:32.570889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:32.570889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:32.570889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:32.578997 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 375/758] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:32.578997 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c5e0a-9968-41da-9ff4-720357c2df68 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:32.629086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d441f-2446-4236-91d3-b57fc53788c3 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:32.700922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0df514-4987-4a56-b4fe-07a8557613bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:32.703214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df514-4987-4a56-b4fe-07a8557613bc None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:32.704613 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df514-4987-4a56-b4fe-07a8557613bc None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:32.705043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0df514-4987-4a56-b4fe-07a8557613bc None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:32.705863 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0df514-4987-4a56-b4fe-07a8557613bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:32.707248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0df514-4987-4a56-b4fe-07a8557613bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:32.707367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:32.710035 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0df514-4987-4a56-b4fe-07a8557613bc None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:32.738991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 384/759] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:32.744470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0df514-4987-4a56-b4fe-07a8557613bc None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:32.791404 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c5e0a-9968-41da-9ff4-720357c2df68 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:32.857052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:32.859256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544afc5-f691-445e-b5dd-6b01827de6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:32.860079 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544afc5-f691-445e-b5dd-6b01827de6a0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:32.860552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544afc5-f691-445e-b5dd-6b01827de6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:32.860986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544afc5-f691-445e-b5dd-6b01827de6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:32.861776 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544afc5-f691-445e-b5dd-6b01827de6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:32.862225 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544afc5-f691-445e-b5dd-6b01827de6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:32.868463 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544afc5-f691-445e-b5dd-6b01827de6a0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:32.894471 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 376/760] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:32.899767 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544afc5-f691-445e-b5dd-6b01827de6a0 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:32.948704 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0df514-4987-4a56-b4fe-07a8557613bc None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:33.024486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f29e0-2191-41fa-ba9a-e555e2e82d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:33.025159 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f29e0-2191-41fa-ba9a-e555e2e82d93 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.025433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f29e0-2191-41fa-ba9a-e555e2e82d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.025706 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f29e0-2191-41fa-ba9a-e555e2e82d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.042322 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f29e0-2191-41fa-ba9a-e555e2e82d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:33.043899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f29e0-2191-41fa-ba9a-e555e2e82d93 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-873f29e0-2191-41fa-ba9a-e555e2e82d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:33.073283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:33.074246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:33.076702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:33.076702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:33.076702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:33.076702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:33.076702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:33.076702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:33.076702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:33.076702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:33.076702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 385/761] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:33.081340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f29e0-2191-41fa-ba9a-e555e2e82d93 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:33.117491 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544afc5-f691-445e-b5dd-6b01827de6a0 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:33.156887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:33.171638 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352c3ab-f962-459d-a887-dd27ca0e29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:33.172276 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352c3ab-f962-459d-a887-dd27ca0e29eb None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.172555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352c3ab-f962-459d-a887-dd27ca0e29eb None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.172831 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352c3ab-f962-459d-a887-dd27ca0e29eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.180055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352c3ab-f962-459d-a887-dd27ca0e29eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:33.181482 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352c3ab-f962-459d-a887-dd27ca0e29eb None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-2352c3ab-f962-459d-a887-dd27ca0e29eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:33.193521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:33.194611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:33.195568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:33.195568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:33.195568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:33.195568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:33.195568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:33.195568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:33.195568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:33.195568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:33.195568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 377/762] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:33.196061 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94698-0a8a-4c1a-928e-486876fe878d None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.196061 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94698-0a8a-4c1a-928e-486876fe878d None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.196474 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f94698-0a8a-4c1a-928e-486876fe878d None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.197778 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 378/763] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:33.198790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291edcea-b66d-4c88-a4d1-a33722027149 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.199092 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291edcea-b66d-4c88-a4d1-a33722027149 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.199642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291edcea-b66d-4c88-a4d1-a33722027149 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.201927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 379/764] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:33.202500 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291edcea-b66d-4c88-a4d1-a33722027149 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:33.234214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f29e0-2191-41fa-ba9a-e555e2e82d93 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:33.251543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:33.273350 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6a50-dcd0-493c-a111-ad2633a8d60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:33.273956 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6a50-dcd0-493c-a111-ad2633a8d60f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.274233 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6a50-dcd0-493c-a111-ad2633a8d60f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.274502 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6a50-dcd0-493c-a111-ad2633a8d60f None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.275280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6a50-dcd0-493c-a111-ad2633a8d60f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:33.275587 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6a50-dcd0-493c-a111-ad2633a8d60f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:33.276991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6a50-dcd0-493c-a111-ad2633a8d60f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:33.290854 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 386/765] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:33.293150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb053-6028-4cb9-b4a6-da4e4c2e9fc2 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.293718 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb053-6028-4cb9-b4a6-da4e4c2e9fc2 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.294710 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb053-6028-4cb9-b4a6-da4e4c2e9fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.311501 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291edcea-b66d-4c88-a4d1-a33722027149 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:33.319398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-11cfb053-6028-4cb9-b4a6-da4e4c2e9fc2 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:33.321589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-11cfb053-6028-4cb9-b4a6-da4e4c2e9fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:33.348227 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb1f85-d997-453d-9207-925f143d0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:33.348844 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1f85-d997-453d-9207-925f143d0c3c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.349280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1f85-d997-453d-9207-925f143d0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.349561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb1f85-d997-453d-9207-925f143d0c3c None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.350256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1f85-d997-453d-9207-925f143d0c3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:33.350564 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1f85-d997-453d-9207-925f143d0c3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:33.352056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb1f85-d997-453d-9207-925f143d0c3c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:33.369752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 380/766] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:33.369752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d571ea-0b63-4d61-b98b-834694b50954 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.369752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d571ea-0b63-4d61-b98b-834694b50954 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.369752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d571ea-0b63-4d61-b98b-834694b50954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.391974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-26d571ea-0b63-4d61-b98b-834694b50954 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:33.393154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-26d571ea-0b63-4d61-b98b-834694b50954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:33.423064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 387/767] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:33.423064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfb053-6028-4cb9-b4a6-da4e4c2e9fc2 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:33.437031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:33.479109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 381/768] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:33.479980 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d571ea-0b63-4d61-b98b-834694b50954 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:33.592543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfb053-6028-4cb9-b4a6-da4e4c2e9fc2 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:33.599158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:33.686194 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d571ea-0b63-4d61-b98b-834694b50954 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:33.726239 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa0530-94de-4e70-bd11-c86436c35bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:33.726871 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa0530-94de-4e70-bd11-c86436c35bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.727373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa0530-94de-4e70-bd11-c86436c35bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.727490 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa0530-94de-4e70-bd11-c86436c35bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.728185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa0530-94de-4e70-bd11-c86436c35bf2 None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=48ba8f16b64e4625866d7052846d906a) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:33.728496 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa0530-94de-4e70-bd11-c86436c35bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:33.729945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa0530-94de-4e70-bd11-c86436c35bf2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:33.737992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 382/769] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:33 2022] GET /identity/v3/role_assignments?user.id=48ba8f16b64e4625866d7052846d906a&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:33.739396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acfbba-d192-4fb7-b7b9-584640491564 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.739684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acfbba-d192-4fb7-b7b9-584640491564 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.739962 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acfbba-d192-4fb7-b7b9-584640491564 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.741558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 383/770] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:33.747726 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbe620-5108-422d-871e-91d28c6b2bfb None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.748008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbe620-5108-422d-871e-91d28c6b2bfb None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.748282 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbe620-5108-422d-871e-91d28c6b2bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.771089 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-53dbe620-5108-422d-871e-91d28c6b2bfb None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:33.772308 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-53dbe620-5108-422d-871e-91d28c6b2bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:33.805264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:33.810168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25cabd-e7b3-4b6b-98e4-4d0f3bc745e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:33.810853 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25cabd-e7b3-4b6b-98e4-4d0f3bc745e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:33.811167 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25cabd-e7b3-4b6b-98e4-4d0f3bc745e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:33.811438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25cabd-e7b3-4b6b-98e4-4d0f3bc745e0 None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/bfb0254e89514ff18e1c91dc427e4b1e/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:33.813395 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25cabd-e7b3-4b6b-98e4-4d0f3bc745e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=bfb0254e89514ff18e1c91dc427e4b1e, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:33.814858 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25cabd-e7b3-4b6b-98e4-4d0f3bc745e0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:33.830516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 388/771] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:39:33 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/bfb0254e89514ff18e1c91dc427e4b1e/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:39:33.831404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25cabd-e7b3-4b6b-98e4-4d0f3bc745e0 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:33.876442 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 384/772] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:33.877781 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbe620-5108-422d-871e-91d28c6b2bfb None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.008092 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbe620-5108-422d-871e-91d28c6b2bfb None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.032778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25cabd-e7b3-4b6b-98e4-4d0f3bc745e0 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.048397 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed0038-d771-4f98-a85a-c48330a0991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.049306 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed0038-d771-4f98-a85a-c48330a0991a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.049736 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed0038-d771-4f98-a85a-c48330a0991a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.050266 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed0038-d771-4f98-a85a-c48330a0991a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.051159 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed0038-d771-4f98-a85a-c48330a0991a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.052719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed0038-d771-4f98-a85a-c48330a0991a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e4ed0038-d771-4f98-a85a-c48330a0991a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:34.066516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:34.067633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:34.069154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 385/773] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Oct 3 14:39:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:34.075165 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed0038-d771-4f98-a85a-c48330a0991a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.080145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceca14-b6fc-4749-989c-b6605c1f9c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.080790 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceca14-b6fc-4749-989c-b6605c1f9c4f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.081072 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceca14-b6fc-4749-989c-b6605c1f9c4f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.081344 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceca14-b6fc-4749-989c-b6605c1f9c4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.094283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceca14-b6fc-4749-989c-b6605c1f9c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-11ceca14-b6fc-4749-989c-b6605c1f9c4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:34.099222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:34.100153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:34.105966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 389/774] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:34.112455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceca14-b6fc-4749-989c-b6605c1f9c4f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.140312 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:34.145886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:34.219973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceca14-b6fc-4749-989c-b6605c1f9c4f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.256705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965cc1d-3aae-468a-8cb5-749cc7e29997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.257680 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965cc1d-3aae-468a-8cb5-749cc7e29997 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.258222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965cc1d-3aae-468a-8cb5-749cc7e29997 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.258782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965cc1d-3aae-468a-8cb5-749cc7e29997 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.259679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965cc1d-3aae-468a-8cb5-749cc7e29997 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:34.260085 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965cc1d-3aae-468a-8cb5-749cc7e29997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.261621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965cc1d-3aae-468a-8cb5-749cc7e29997 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.275083 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 390/775] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:34.276105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965cc1d-3aae-468a-8cb5-749cc7e29997 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.279469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed0038-d771-4f98-a85a-c48330a0991a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.316306 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf705178-bbe9-45e6-a331-053bd110a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.317260 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf705178-bbe9-45e6-a331-053bd110a806 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.318145 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf705178-bbe9-45e6-a331-053bd110a806 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.318651 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf705178-bbe9-45e6-a331-053bd110a806 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.319503 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf705178-bbe9-45e6-a331-053bd110a806 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:34.320346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf705178-bbe9-45e6-a331-053bd110a806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.322635 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf705178-bbe9-45e6-a331-053bd110a806 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.329709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 386/776] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:34.330913 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf705178-bbe9-45e6-a331-053bd110a806 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.367409 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:34.383503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965cc1d-3aae-468a-8cb5-749cc7e29997 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.432605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b44a2-aa23-4181-8946-d1e340cc28ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.433534 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b44a2-aa23-4181-8946-d1e340cc28ab None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.434577 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b44a2-aa23-4181-8946-d1e340cc28ab None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.435138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b44a2-aa23-4181-8946-d1e340cc28ab None admin] PATH_INFO: `/v3/services/network` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.436476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b44a2-aa23-4181-8946-d1e340cc28ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.438446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b44a2-aa23-4181-8946-d1e340cc28ab None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-4d4b44a2-aa23-4181-8946-d1e340cc28ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:34.449345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:34.450917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 14:39:34.451929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:34.452761 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:34.454744 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 391/777] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:34.460203 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf705178-bbe9-45e6-a331-053bd110a806 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.460614 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b44a2-aa23-4181-8946-d1e340cc28ab None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.498443 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7bbef-72c4-4137-a0c7-7f4cd451c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.499195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bbef-72c4-4137-a0c7-7f4cd451c3e8 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.499548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bbef-72c4-4137-a0c7-7f4cd451c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.499892 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bbef-72c4-4137-a0c7-7f4cd451c3e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.511398 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7bbef-72c4-4137-a0c7-7f4cd451c3e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.513411 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7bbef-72c4-4137-a0c7-7f4cd451c3e8 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-30f7bbef-72c4-4137-a0c7-7f4cd451c3e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:34.529346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:34.530347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:34.531259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:34.531259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:34.531259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:34.535171 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 387/778] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:34.536139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7bbef-72c4-4137-a0c7-7f4cd451c3e8 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.570564 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b44a2-aa23-4181-8946-d1e340cc28ab None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.604938 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a14d5-1bd9-4787-a72f-3b6d9485518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.605914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a14d5-1bd9-4787-a72f-3b6d9485518b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.606279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a14d5-1bd9-4787-a72f-3b6d9485518b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.606806 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a14d5-1bd9-4787-a72f-3b6d9485518b None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.607543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a14d5-1bd9-4787-a72f-3b6d9485518b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:34.607903 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a14d5-1bd9-4787-a72f-3b6d9485518b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.609323 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a14d5-1bd9-4787-a72f-3b6d9485518b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.615719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 392/779] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:34.616716 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a14d5-1bd9-4787-a72f-3b6d9485518b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.635346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:34.657076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7bbef-72c4-4137-a0c7-7f4cd451c3e8 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.703349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e021138-6614-4302-b1f9-8370bdddf1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.705183 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021138-6614-4302-b1f9-8370bdddf1f8 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.705663 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021138-6614-4302-b1f9-8370bdddf1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.706122 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021138-6614-4302-b1f9-8370bdddf1f8 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.707071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e021138-6614-4302-b1f9-8370bdddf1f8 None admin] RBAC: Adding query filter params (name=network) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:34.708062 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e021138-6614-4302-b1f9-8370bdddf1f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.711415 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e021138-6614-4302-b1f9-8370bdddf1f8 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.719557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 388/780] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:34.720838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e021138-6614-4302-b1f9-8370bdddf1f8 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.736113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:34.743726 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a14d5-1bd9-4787-a72f-3b6d9485518b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.787297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1259b-5e1f-4ead-99bf-c57e788448f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.787835 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1259b-5e1f-4ead-99bf-c57e788448f2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.788183 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1259b-5e1f-4ead-99bf-c57e788448f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.788528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1259b-5e1f-4ead-99bf-c57e788448f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.789237 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1259b-5e1f-4ead-99bf-c57e788448f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:34.789875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1259b-5e1f-4ead-99bf-c57e788448f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.791090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1259b-5e1f-4ead-99bf-c57e788448f2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.803672 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 393/781] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:34.804576 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1259b-5e1f-4ead-99bf-c57e788448f2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.867866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e021138-6614-4302-b1f9-8370bdddf1f8 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.885726 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:34.918915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1259b-5e1f-4ead-99bf-c57e788448f2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:34.924991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aededa-c30f-454f-8611-4e823a611008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.925850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aededa-c30f-454f-8611-4e823a611008 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.926351 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aededa-c30f-454f-8611-4e823a611008 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.927411 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aededa-c30f-454f-8611-4e823a611008 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.928339 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aededa-c30f-454f-8611-4e823a611008 None admin] RBAC: Adding query filter params (interface=public, service_id=51da1a6f47e347d29b665202dabf57a4, region_id=RegionOne) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:34.929316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aededa-c30f-454f-8611-4e823a611008 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.931367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aededa-c30f-454f-8611-4e823a611008 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.942717 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 389/782] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/endpoints?service_id=51da1a6f47e347d29b665202dabf57a4&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:34.944369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aededa-c30f-454f-8611-4e823a611008 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:34.956800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84586aa3-c57e-4ece-9b7c-889592da371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:34.957796 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586aa3-c57e-4ece-9b7c-889592da371b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:34.957920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586aa3-c57e-4ece-9b7c-889592da371b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:34.958370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586aa3-c57e-4ece-9b7c-889592da371b None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:34.959122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84586aa3-c57e-4ece-9b7c-889592da371b None admin] RBAC: Adding query filter params (type=network) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:34.959521 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84586aa3-c57e-4ece-9b7c-889592da371b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:34.960982 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84586aa3-c57e-4ece-9b7c-889592da371b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:34.971121 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 394/783] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:34.972074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84586aa3-c57e-4ece-9b7c-889592da371b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:35.038623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:35.070283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aededa-c30f-454f-8611-4e823a611008 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:35.097670 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84586aa3-c57e-4ece-9b7c-889592da371b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:35.112419 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2f2c-364b-4872-8ca4-072f944e70f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:35.113270 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2f2c-364b-4872-8ca4-072f944e70f5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:35.113646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2f2c-364b-4872-8ca4-072f944e70f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:35.114021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2f2c-364b-4872-8ca4-072f944e70f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:35.121808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a2f2c-364b-4872-8ca4-072f944e70f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:35.123679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a2f2c-364b-4872-8ca4-072f944e70f5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-299a2f2c-364b-4872-8ca4-072f944e70f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:35.135643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:35.136813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:35.138785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:35.140557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 390/784] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:35.141553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2f2c-364b-4872-8ca4-072f944e70f5 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:35.146637 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6021c-7748-424a-a654-db8924c624ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:35.147470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6021c-7748-424a-a654-db8924c624ae None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:35.147930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6021c-7748-424a-a654-db8924c624ae None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:35.148353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6021c-7748-424a-a654-db8924c624ae None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:35.149099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6021c-7748-424a-a654-db8924c624ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:35.150605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6021c-7748-424a-a654-db8924c624ae None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:35.158661 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 395/785] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Oct 3 14:39:34 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:35.159701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6021c-7748-424a-a654-db8924c624ae None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:35.162533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:35.285850 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6021c-7748-424a-a654-db8924c624ae None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:35.366563 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784986a-1b61-4dc7-b88b-dc1176581b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:35.367232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784986a-1b61-4dc7-b88b-dc1176581b53 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:35.367516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784986a-1b61-4dc7-b88b-dc1176581b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:35.368036 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784986a-1b61-4dc7-b88b-dc1176581b53 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:35.369891 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784986a-1b61-4dc7-b88b-dc1176581b53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:35.370467 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784986a-1b61-4dc7-b88b-dc1176581b53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:35.372503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784986a-1b61-4dc7-b88b-dc1176581b53 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:35.378789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2f2c-364b-4872-8ca4-072f944e70f5 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:35.413291 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 396/786] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Oct 3 14:39:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:35.420338 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784986a-1b61-4dc7-b88b-dc1176581b53 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:35.434850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:35.440811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd588-4fe4-4d46-8192-b8f9c3a2bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:35.441693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd588-4fe4-4d46-8192-b8f9c3a2bf77 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:35.442303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd588-4fe4-4d46-8192-b8f9c3a2bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:35.443158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cd588-4fe4-4d46-8192-b8f9c3a2bf77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:35.443453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cd588-4fe4-4d46-8192-b8f9c3a2bf77 None admin] RBAC: Adding query filter params (interface=public, service_id=2ec7579594cb41eab523c4add0c7dc12, region_id=RegionOne) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:35.443771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cd588-4fe4-4d46-8192-b8f9c3a2bf77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:35.445135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cd588-4fe4-4d46-8192-b8f9c3a2bf77 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:35.451545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 391/787] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Oct 3 14:39:35 2022] GET /identity/v3/endpoints?service_id=2ec7579594cb41eab523c4add0c7dc12&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:35.458389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd588-4fe4-4d46-8192-b8f9c3a2bf77 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:35.513847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:35.567626 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784986a-1b61-4dc7-b88b-dc1176581b53 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:35.622693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cd588-4fe4-4d46-8192-b8f9c3a2bf77 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:35.643415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263925e-9481-4c71-a764-a93392e48393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:35.644102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263925e-9481-4c71-a764-a93392e48393 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:35.644389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263925e-9481-4c71-a764-a93392e48393 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:35.644664 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263925e-9481-4c71-a764-a93392e48393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:35.665296 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263925e-9481-4c71-a764-a93392e48393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:35.666747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263925e-9481-4c71-a764-a93392e48393 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-d263925e-9481-4c71-a764-a93392e48393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:35.685214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:35.686313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:35.687487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:35.687487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:35.687487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:35.687487 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 397/788] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:35.693396 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263925e-9481-4c71-a764-a93392e48393 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:35.696741 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacff8aa-61e8-4a4f-bc43-9df5461e8b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:35.697487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff8aa-61e8-4a4f-bc43-9df5461e8b72 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:35.697766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff8aa-61e8-4a4f-bc43-9df5461e8b72 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:35.698032 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacff8aa-61e8-4a4f-bc43-9df5461e8b72 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:35.698637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacff8aa-61e8-4a4f-bc43-9df5461e8b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:35.700616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacff8aa-61e8-4a4f-bc43-9df5461e8b72 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:35.713584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 392/789] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Oct 3 14:39:35 2022] GET /identity/v3/services => generated 772 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:35.826316 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263925e-9481-4c71-a764-a93392e48393 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:35.840413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:35.864097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e815-f2c2-4bc4-a853-13329e996dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:35.865188 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e815-f2c2-4bc4-a853-13329e996dfa None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:35.865678 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e815-f2c2-4bc4-a853-13329e996dfa None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:35.866155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e815-f2c2-4bc4-a853-13329e996dfa None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:35.867054 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e815-f2c2-4bc4-a853-13329e996dfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:35.867662 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e815-f2c2-4bc4-a853-13329e996dfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:35.869304 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e815-f2c2-4bc4-a853-13329e996dfa None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:35.889131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 398/790] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:35.894627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacff8aa-61e8-4a4f-bc43-9df5461e8b72 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:35.983911 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:36.040954 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacff8aa-61e8-4a4f-bc43-9df5461e8b72 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:36.097516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1ce5-5a84-4ea3-9783-de18e7c1ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:36.098165 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1ce5-5a84-4ea3-9783-de18e7c1ad42 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:36.098446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1ce5-5a84-4ea3-9783-de18e7c1ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:36.098720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1ce5-5a84-4ea3-9783-de18e7c1ad42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:36.116028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1ce5-5a84-4ea3-9783-de18e7c1ad42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:36.117479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1ce5-5a84-4ea3-9783-de18e7c1ad42 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-cfcf1ce5-5a84-4ea3-9783-de18e7c1ad42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:36.132130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:36.133108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:36.134031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:36.134031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:36.134031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:36.134031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:36.134031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:36.134031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:36.134031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:36.134031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:36.134031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 393/791] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:36.139342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e815-f2c2-4bc4-a853-13329e996dfa None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:36.194293 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555b7e3-c089-45ed-bc1e-26e615a710b8 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:36.194645 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555b7e3-c089-45ed-bc1e-26e615a710b8 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:36.194875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555b7e3-c089-45ed-bc1e-26e615a710b8 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:36.196469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 394/792] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:36.214746 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e994d-456e-4adb-97b6-81075d0d4e61 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:36.215072 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e994d-456e-4adb-97b6-81075d0d4e61 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:36.215328 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e994d-456e-4adb-97b6-81075d0d4e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:36.255110 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-439e994d-456e-4adb-97b6-81075d0d4e61 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:36.260115 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-439e994d-456e-4adb-97b6-81075d0d4e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:36.331120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e815-f2c2-4bc4-a853-13329e996dfa None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:36.397883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 395/793] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Oct 03 14:39:36.397883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4f1be-6aa5-4f9b-9414-6d73374a3674 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:36.397883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4f1be-6aa5-4f9b-9414-6d73374a3674 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:36.397883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4f1be-6aa5-4f9b-9414-6d73374a3674 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:36.397883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 396/794] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:36.402115 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55eae7-fc26-495d-80cd-1fdc33ced266 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:36.402406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55eae7-fc26-495d-80cd-1fdc33ced266 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:36.402681 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55eae7-fc26-495d-80cd-1fdc33ced266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:36.404096 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb29c32-4c7c-4e19-a5c6-a3fb9e6a8894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:36.405374 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb29c32-4c7c-4e19-a5c6-a3fb9e6a8894 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:36.405861 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb29c32-4c7c-4e19-a5c6-a3fb9e6a8894 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:36.406447 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb29c32-4c7c-4e19-a5c6-a3fb9e6a8894 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:36.409053 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb29c32-4c7c-4e19-a5c6-a3fb9e6a8894 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:36.409585 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb29c32-4c7c-4e19-a5c6-a3fb9e6a8894 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:36.411303 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb29c32-4c7c-4e19-a5c6-a3fb9e6a8894 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:36.424397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 399/795] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:36.432676 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb29c32-4c7c-4e19-a5c6-a3fb9e6a8894 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:36.436128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-8a55eae7-fc26-495d-80cd-1fdc33ced266 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:36.437314 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-8a55eae7-fc26-495d-80cd-1fdc33ced266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:36.472057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:36.509985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:36.548141 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 397/796] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:36.598582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb29c32-4c7c-4e19-a5c6-a3fb9e6a8894 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:36.648360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a16ca-d6ec-431a-a999-1e9dcced7435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:36.648964 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a16ca-d6ec-431a-a999-1e9dcced7435 None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:36.649246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a16ca-d6ec-431a-a999-1e9dcced7435 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:36.649526 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a16ca-d6ec-431a-a999-1e9dcced7435 None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/29b7487e76304a87bd9d07d1f63b01d3/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:36.651455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a16ca-d6ec-431a-a999-1e9dcced7435 None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=29b7487e76304a87bd9d07d1f63b01d3, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:36.652885 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a16ca-d6ec-431a-a999-1e9dcced7435 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:36.677755 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 400/797] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:39:36 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/29b7487e76304a87bd9d07d1f63b01d3/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 14:39:36.732073 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55eae7-fc26-495d-80cd-1fdc33ced266 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:36.869884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55eae7-fc26-495d-80cd-1fdc33ced266 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:36.918244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab43117-b5c1-476d-b9f0-46fa596b32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:36.918867 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab43117-b5c1-476d-b9f0-46fa596b32cb None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:36.919194 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab43117-b5c1-476d-b9f0-46fa596b32cb None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:36.919471 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab43117-b5c1-476d-b9f0-46fa596b32cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:36.924496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a16ca-d6ec-431a-a999-1e9dcced7435 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:36.930678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab43117-b5c1-476d-b9f0-46fa596b32cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-9ab43117-b5c1-476d-b9f0-46fa596b32cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:36.936279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:36.937252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:36.938107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 398/798] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:36.945261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab43117-b5c1-476d-b9f0-46fa596b32cb None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:37.001248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:37.036922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:37.049045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a16ca-d6ec-431a-a999-1e9dcced7435 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:37.068751 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab43117-b5c1-476d-b9f0-46fa596b32cb None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:37.096503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791c919-7438-4f8a-b13b-279ef528a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:37.097370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c919-7438-4f8a-b13b-279ef528a4bd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.097692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c919-7438-4f8a-b13b-279ef528a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.098067 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791c919-7438-4f8a-b13b-279ef528a4bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:37.116162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791c919-7438-4f8a-b13b-279ef528a4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:37.121285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3329f6-24c5-48b9-9d91-f77305557796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:37.122675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3329f6-24c5-48b9-9d91-f77305557796 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-9791c919-7438-4f8a-b13b-279ef528a4bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:37.122847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:37.123943 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:37.125056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:37.126248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3329f6-24c5-48b9-9d91-f77305557796 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.126661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3329f6-24c5-48b9-9d91-f77305557796 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:37.127234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 401/799] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:37.127665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3329f6-24c5-48b9-9d91-f77305557796 None admin] RBAC: Adding query filter params (name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:37.127968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3329f6-24c5-48b9-9d91-f77305557796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:37.129387 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3329f6-24c5-48b9-9d91-f77305557796 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:37.132745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791c919-7438-4f8a-b13b-279ef528a4bd None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:37.151220 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 399/800] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:37.157378 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3329f6-24c5-48b9-9d91-f77305557796 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:37.245173 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791c919-7438-4f8a-b13b-279ef528a4bd None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:37.306485 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63178025-9045-4139-89c8-a685c29a27e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:37.308722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63178025-9045-4139-89c8-a685c29a27e7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.309571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63178025-9045-4139-89c8-a685c29a27e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.311386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63178025-9045-4139-89c8-a685c29a27e7 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:37.312276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63178025-9045-4139-89c8-a685c29a27e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:37.312856 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63178025-9045-4139-89c8-a685c29a27e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:37.314562 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63178025-9045-4139-89c8-a685c29a27e7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:37.333027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 402/801] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:37.339346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63178025-9045-4139-89c8-a685c29a27e7 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:37.351554 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3329f6-24c5-48b9-9d91-f77305557796 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:37.353476 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:37.386051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:37.400542 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb59f45-35a3-47ae-8b48-355b59d9b7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:37.401608 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb59f45-35a3-47ae-8b48-355b59d9b7bc None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.402095 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb59f45-35a3-47ae-8b48-355b59d9b7bc None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.402601 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb59f45-35a3-47ae-8b48-355b59d9b7bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:37.425601 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb59f45-35a3-47ae-8b48-355b59d9b7bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:37.430679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb59f45-35a3-47ae-8b48-355b59d9b7bc None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-dbb59f45-35a3-47ae-8b48-355b59d9b7bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:37.458852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:37.459883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:37.460830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:37.460830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:37.460830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:37.468974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 400/802] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:37.473757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb59f45-35a3-47ae-8b48-355b59d9b7bc None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:37.520865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63178025-9045-4139-89c8-a685c29a27e7 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:37.572521 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea565c-a8b7-4ea1-97f5-bc070fff474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:37.573535 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea565c-a8b7-4ea1-97f5-bc070fff474e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.574025 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea565c-a8b7-4ea1-97f5-bc070fff474e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.575023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea565c-a8b7-4ea1-97f5-bc070fff474e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:37.599923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea565c-a8b7-4ea1-97f5-bc070fff474e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:37.601644 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea565c-a8b7-4ea1-97f5-bc070fff474e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-e2ea565c-a8b7-4ea1-97f5-bc070fff474e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:37.652290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:37.654089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:37.655014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:37.655014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:37.655014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:37.655014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 403/803] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:37.661884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb59f45-35a3-47ae-8b48-355b59d9b7bc None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:37.663987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea565c-a8b7-4ea1-97f5-bc070fff474e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:37.714849 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56335ae-9c70-4601-9f44-adfe5fca1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:37.715480 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56335ae-9c70-4601-9f44-adfe5fca1899 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.716289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56335ae-9c70-4601-9f44-adfe5fca1899 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.716558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56335ae-9c70-4601-9f44-adfe5fca1899 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:37.717195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56335ae-9c70-4601-9f44-adfe5fca1899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:37.717492 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56335ae-9c70-4601-9f44-adfe5fca1899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:37.721156 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56335ae-9c70-4601-9f44-adfe5fca1899 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:37.745989 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 401/804] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:37.752270 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56335ae-9c70-4601-9f44-adfe5fca1899 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:37.782697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:37.787190 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:37.829336 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea565c-a8b7-4ea1-97f5-bc070fff474e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:37.873990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afacb-6424-41a0-92b0-855f5d7c140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:37.874598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afacb-6424-41a0-92b0-855f5d7c140f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.874876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afacb-6424-41a0-92b0-855f5d7c140f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.875179 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afacb-6424-41a0-92b0-855f5d7c140f None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:37.875811 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afacb-6424-41a0-92b0-855f5d7c140f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:37.876108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afacb-6424-41a0-92b0-855f5d7c140f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:37.877455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afacb-6424-41a0-92b0-855f5d7c140f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:37.891220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 404/805] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:37.891789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56335ae-9c70-4601-9f44-adfe5fca1899 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:37.893183 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049b07d-503a-4790-888e-4b28c58cf665 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.893824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049b07d-503a-4790-888e-4b28c58cf665 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.895149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049b07d-503a-4790-888e-4b28c58cf665 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:37.896625 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 405/806] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:37.897612 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049b07d-503a-4790-888e-4b28c58cf665 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:37.940397 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec53e8f-e005-43f0-9ffa-464aee0c71c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:37.941468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53e8f-e005-43f0-9ffa-464aee0c71c2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.942221 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53e8f-e005-43f0-9ffa-464aee0c71c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.942693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec53e8f-e005-43f0-9ffa-464aee0c71c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:37.952924 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53e8f-e005-43f0-9ffa-464aee0c71c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:37.955363 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec53e8f-e005-43f0-9ffa-464aee0c71c2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-1ec53e8f-e005-43f0-9ffa-464aee0c71c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:37.970977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:37.971986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:37.972945 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:37.976103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 402/807] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:39:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:37.977541 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ee893-8d94-4957-8522-2313c5897cb6 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:37.978019 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ee893-8d94-4957-8522-2313c5897cb6 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:37.978533 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ee893-8d94-4957-8522-2313c5897cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.002972 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a97ee893-8d94-4957-8522-2313c5897cb6 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:38.004946 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a97ee893-8d94-4957-8522-2313c5897cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:38.024138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049b07d-503a-4790-888e-4b28c58cf665 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:38.053539 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.063477 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a28ac-7847-416c-ad58-e3f8ade69872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:38.064115 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a28ac-7847-416c-ad58-e3f8ade69872 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:38.064391 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a28ac-7847-416c-ad58-e3f8ade69872 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:38.064662 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a28ac-7847-416c-ad58-e3f8ade69872 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.071995 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a28ac-7847-416c-ad58-e3f8ade69872 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:38.073411 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a28ac-7847-416c-ad58-e3f8ade69872 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-078a28ac-7847-416c-ad58-e3f8ade69872 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:38.086808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:38.087824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:39:38.088855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:38.097654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 406/808] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Oct 3 14:39:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:38.097654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a28ac-7847-416c-ad58-e3f8ade69872 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:38.111432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 403/809] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:38.112697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ee893-8d94-4957-8522-2313c5897cb6 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:38.116210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.242389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ee893-8d94-4957-8522-2313c5897cb6 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:38.251543 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a28ac-7847-416c-ad58-e3f8ade69872 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:38.299548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0726992-e7e3-4698-b52e-7863c21c56dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:38.300253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726aa4b9-ee92-439c-a014-9ba00c76633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:38.300886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726aa4b9-ee92-439c-a014-9ba00c76633a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:38.301163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726aa4b9-ee92-439c-a014-9ba00c76633a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:38.301433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726aa4b9-ee92-439c-a014-9ba00c76633a None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.302789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726992-e7e3-4698-b52e-7863c21c56dd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:38.303095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726aa4b9-ee92-439c-a014-9ba00c76633a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:38.303403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726aa4b9-ee92-439c-a014-9ba00c76633a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:38.304990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726992-e7e3-4698-b52e-7863c21c56dd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:38.305212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0726992-e7e3-4698-b52e-7863c21c56dd None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.305947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0726992-e7e3-4698-b52e-7863c21c56dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:38.306250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0726992-e7e3-4698-b52e-7863c21c56dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:38.307683 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0726992-e7e3-4698-b52e-7863c21c56dd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:38.309733 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726aa4b9-ee92-439c-a014-9ba00c76633a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:38.329123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 407/810] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Oct 3 14:39:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:38.334632 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726aa4b9-ee92-439c-a014-9ba00c76633a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:38.351858 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 404/811] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Oct 3 14:39:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:38.357320 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0726992-e7e3-4698-b52e-7863c21c56dd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:38.424194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.448807 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.490115 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726aa4b9-ee92-439c-a014-9ba00c76633a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:38.494103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0726992-e7e3-4698-b52e-7863c21c56dd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:38.528555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a5051-1783-4606-8853-5d4a14fe5a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:38.528887 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03108793-9ec1-4959-80f0-07f624ef74be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:38.529310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a5051-1783-4606-8853-5d4a14fe5a3b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:38.529389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03108793-9ec1-4959-80f0-07f624ef74be None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:38.529460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a5051-1783-4606-8853-5d4a14fe5a3b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:38.529573 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03108793-9ec1-4959-80f0-07f624ef74be None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:38.529839 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a5051-1783-4606-8853-5d4a14fe5a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.529936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03108793-9ec1-4959-80f0-07f624ef74be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.540185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03108793-9ec1-4959-80f0-07f624ef74be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:38.542463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03108793-9ec1-4959-80f0-07f624ef74be None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-03108793-9ec1-4959-80f0-07f624ef74be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:38.560961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:38.561946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:38.562836 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:38.562836 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:38.562836 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:38.567939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 408/812] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:38.567939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442a203-941d-4aa2-8cd5-d13d3a2aafd9 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:38.567939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442a203-941d-4aa2-8cd5-d13d3a2aafd9 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:38.567939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442a203-941d-4aa2-8cd5-d13d3a2aafd9 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.567939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 409/813] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:38.567939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442a203-941d-4aa2-8cd5-d13d3a2aafd9 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:38.605004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a5051-1783-4606-8853-5d4a14fe5a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:38.606487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a5051-1783-4606-8853-5d4a14fe5a3b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:38.668274 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.681342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.689648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442a203-941d-4aa2-8cd5-d13d3a2aafd9 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:38.715102 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 405/814] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:39:38.718810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eba15-16d5-4df2-92af-886db282b18e None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:38.719143 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eba15-16d5-4df2-92af-886db282b18e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:38.719431 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eba15-16d5-4df2-92af-886db282b18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.732444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07647e3a-b409-4659-b5a1-7765eacf3446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:38.733289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07647e3a-b409-4659-b5a1-7765eacf3446 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:38.733708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07647e3a-b409-4659-b5a1-7765eacf3446 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:38.733986 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07647e3a-b409-4659-b5a1-7765eacf3446 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.734565 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07647e3a-b409-4659-b5a1-7765eacf3446 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:38.735937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07647e3a-b409-4659-b5a1-7765eacf3446 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:38.737367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-cc4eba15-16d5-4df2-92af-886db282b18e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:38.738618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-cc4eba15-16d5-4df2-92af-886db282b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-07647e3a-b409-4659-b5a1-7765eacf3446 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:38.746652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:38.747951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 14:39:38.748818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:38.751288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 410/815] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Oct 3 14:39:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:38.752750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07647e3a-b409-4659-b5a1-7765eacf3446 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:38.810101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 406/816] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:38.811136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eba15-16d5-4df2-92af-886db282b18e None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:38.869846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07647e3a-b409-4659-b5a1-7765eacf3446 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:38.910043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cf78b-b9da-4327-afbe-f9e4fc3dfd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:38.911087 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cf78b-b9da-4327-afbe-f9e4fc3dfd0d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:38.911569 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cf78b-b9da-4327-afbe-f9e4fc3dfd0d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:38.912076 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cf78b-b9da-4327-afbe-f9e4fc3dfd0d None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:38.912906 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cf78b-b9da-4327-afbe-f9e4fc3dfd0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:38.913404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cf78b-b9da-4327-afbe-f9e4fc3dfd0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:38.915398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cf78b-b9da-4327-afbe-f9e4fc3dfd0d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:38.933668 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 411/817] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:38.935061 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cf78b-b9da-4327-afbe-f9e4fc3dfd0d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:38.943406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:38.956069 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eba15-16d5-4df2-92af-886db282b18e None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:38.963234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:39.004414 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764b31-1ef3-42b8-9d96-cce3c385ab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.005416 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764b31-1ef3-42b8-9d96-cce3c385ab16 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.006385 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764b31-1ef3-42b8-9d96-cce3c385ab16 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.006842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3764b31-1ef3-42b8-9d96-cce3c385ab16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.023255 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3764b31-1ef3-42b8-9d96-cce3c385ab16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.024677 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3764b31-1ef3-42b8-9d96-cce3c385ab16 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e3764b31-1ef3-42b8-9d96-cce3c385ab16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:39.040697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:39.041665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:39.042583 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:39.042583 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:39.042583 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:39.042583 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 407/818] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:39.043306 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764b31-1ef3-42b8-9d96-cce3c385ab16 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.071876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cf78b-b9da-4327-afbe-f9e4fc3dfd0d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:39.118608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742070-4a21-4111-9d02-52d02281519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.119267 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742070-4a21-4111-9d02-52d02281519f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.120029 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742070-4a21-4111-9d02-52d02281519f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.120564 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742070-4a21-4111-9d02-52d02281519f None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.121242 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f742070-4a21-4111-9d02-52d02281519f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:39.121486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f742070-4a21-4111-9d02-52d02281519f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.123623 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f742070-4a21-4111-9d02-52d02281519f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.128438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 412/819] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Oct 3 14:39:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:39.133475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742070-4a21-4111-9d02-52d02281519f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.174561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3764b31-1ef3-42b8-9d96-cce3c385ab16 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:39.216836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b4a22-4356-4a57-a529-80e6377f8b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.217538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b4a22-4356-4a57-a529-80e6377f8b47 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.217823 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b4a22-4356-4a57-a529-80e6377f8b47 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.218100 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b4a22-4356-4a57-a529-80e6377f8b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.226562 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b4a22-4356-4a57-a529-80e6377f8b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.228155 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b4a22-4356-4a57-a529-80e6377f8b47 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.239546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e95b4a22-4356-4a57-a529-80e6377f8b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:39.242055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:39.243028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:39.243931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:39.243931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:39.243931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:39.243931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:39.243931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:39.243931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:39.243931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:39.243931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:39.244356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 408/820] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:39.245905 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b4a22-4356-4a57-a529-80e6377f8b47 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.251942 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:39.265894 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742070-4a21-4111-9d02-52d02281519f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:39.308436 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da752a-85e5-4f63-9f20-07eb94d8d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.309244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da752a-85e5-4f63-9f20-07eb94d8d66b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.309590 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da752a-85e5-4f63-9f20-07eb94d8d66b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.310111 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da752a-85e5-4f63-9f20-07eb94d8d66b None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.311127 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da752a-85e5-4f63-9f20-07eb94d8d66b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:39.311438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da752a-85e5-4f63-9f20-07eb94d8d66b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.313231 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da752a-85e5-4f63-9f20-07eb94d8d66b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.331197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 413/821] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:39.331990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da752a-85e5-4f63-9f20-07eb94d8d66b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.358595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b4a22-4356-4a57-a529-80e6377f8b47 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:39.394103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad4c95-acec-4611-bbe4-ac93b53d724b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.394728 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad4c95-acec-4611-bbe4-ac93b53d724b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.395042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad4c95-acec-4611-bbe4-ac93b53d724b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.395320 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad4c95-acec-4611-bbe4-ac93b53d724b None admin] PATH_INFO: `/v3/services/network` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.395901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad4c95-acec-4611-bbe4-ac93b53d724b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.397318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad4c95-acec-4611-bbe4-ac93b53d724b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-ddad4c95-acec-4611-bbe4-ac93b53d724b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:39.407685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:39.411150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:39.412000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 409/822] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:39 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:39.412784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad4c95-acec-4611-bbe4-ac93b53d724b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.449589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da752a-85e5-4f63-9f20-07eb94d8d66b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:39.486449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:39.490734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb327aa-4e40-45a5-a772-b58b68c2dde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.491371 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb327aa-4e40-45a5-a772-b58b68c2dde9 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.491650 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb327aa-4e40-45a5-a772-b58b68c2dde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.491917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb327aa-4e40-45a5-a772-b58b68c2dde9 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.492533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb327aa-4e40-45a5-a772-b58b68c2dde9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:39.492832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb327aa-4e40-45a5-a772-b58b68c2dde9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.494166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb327aa-4e40-45a5-a772-b58b68c2dde9 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.499305 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 414/823] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Oct 3 14:39:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:39.500085 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb327aa-4e40-45a5-a772-b58b68c2dde9 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.512072 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:39.524931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad4c95-acec-4611-bbe4-ac93b53d724b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:39.561142 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983e2c2-54a5-4adf-a653-b8bac0031d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.561752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e2c2-54a5-4adf-a653-b8bac0031d9e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.562038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e2c2-54a5-4adf-a653-b8bac0031d9e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.562318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e2c2-54a5-4adf-a653-b8bac0031d9e None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.563035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983e2c2-54a5-4adf-a653-b8bac0031d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:39.563337 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983e2c2-54a5-4adf-a653-b8bac0031d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.564751 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983e2c2-54a5-4adf-a653-b8bac0031d9e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.576416 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 410/824] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:39.577626 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b33246-5bdb-4cbc-87dc-acf053194d8c None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.577915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b33246-5bdb-4cbc-87dc-acf053194d8c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.578191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b33246-5bdb-4cbc-87dc-acf053194d8c None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.579407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 411/825] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:39.580097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b33246-5bdb-4cbc-87dc-acf053194d8c None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.619622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb327aa-4e40-45a5-a772-b58b68c2dde9 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:39.668208 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26835-81a9-4500-8315-be66abd752b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.668871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26835-81a9-4500-8315-be66abd752b1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.669169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26835-81a9-4500-8315-be66abd752b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.669551 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26835-81a9-4500-8315-be66abd752b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.676401 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc26835-81a9-4500-8315-be66abd752b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.677842 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc26835-81a9-4500-8315-be66abd752b1 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-1bc26835-81a9-4500-8315-be66abd752b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:39.689830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:39.690916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 415/826] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:39.692122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26835-81a9-4500-8315-be66abd752b1 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.696315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b33246-5bdb-4cbc-87dc-acf053194d8c None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:39.722878 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:39.730752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14f37c-828f-4b76-890e-265ea769197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.731418 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14f37c-828f-4b76-890e-265ea769197b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.731692 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14f37c-828f-4b76-890e-265ea769197b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.731962 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14f37c-828f-4b76-890e-265ea769197b None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.732573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14f37c-828f-4b76-890e-265ea769197b None admin] RBAC: Adding query filter params (name=network) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:39.732870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14f37c-828f-4b76-890e-265ea769197b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.734215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14f37c-828f-4b76-890e-265ea769197b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.738550 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 412/827] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:39:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:39.739683 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6bfc4-6af5-405d-8b2d-2d61dad8cf06 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.739963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6bfc4-6af5-405d-8b2d-2d61dad8cf06 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.740234 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6bfc4-6af5-405d-8b2d-2d61dad8cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.757833 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a2b6bfc4-6af5-405d-8b2d-2d61dad8cf06 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:39.759042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a2b6bfc4-6af5-405d-8b2d-2d61dad8cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:39.767653 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:39.801734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26835-81a9-4500-8315-be66abd752b1 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:39.823797 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 413/828] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:39.824682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6bfc4-6af5-405d-8b2d-2d61dad8cf06 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.834426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29f36a-bb77-4caf-9452-2e771fc649cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:39.835057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29f36a-bb77-4caf-9452-2e771fc649cb None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:39.835406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29f36a-bb77-4caf-9452-2e771fc649cb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:39.835957 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29f36a-bb77-4caf-9452-2e771fc649cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:39.836680 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29f36a-bb77-4caf-9452-2e771fc649cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:39.838075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29f36a-bb77-4caf-9452-2e771fc649cb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:39.862912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 416/829] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:39:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:39.863654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29f36a-bb77-4caf-9452-2e771fc649cb None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:39.979307 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6bfc4-6af5-405d-8b2d-2d61dad8cf06 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:40.007189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:40.022858 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29f36a-bb77-4caf-9452-2e771fc649cb None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:40.029581 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e101438-0af7-4289-9576-d62ad1293ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:40.031770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e101438-0af7-4289-9576-d62ad1293ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:40.032158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e101438-0af7-4289-9576-d62ad1293ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:40.032538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e101438-0af7-4289-9576-d62ad1293ae3 None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/48ba8f16b64e4625866d7052846d906a/roles/2a99e98f227647c7af60a10d5fe5ad3c` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:40.052383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:40.053074 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e101438-0af7-4289-9576-d62ad1293ae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=48ba8f16b64e4625866d7052846d906a, role_id=2a99e98f227647c7af60a10d5fe5ad3c)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:40.055134 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e101438-0af7-4289-9576-d62ad1293ae3 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:40.071028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 414/830] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:39:39 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/48ba8f16b64e4625866d7052846d906a/roles/2a99e98f227647c7af60a10d5fe5ad3c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:39:40.072289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e101438-0af7-4289-9576-d62ad1293ae3 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:40.076528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51105f82-17cb-4d9e-872f-b841b631d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:40.077504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51105f82-17cb-4d9e-872f-b841b631d8aa None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:40.077995 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51105f82-17cb-4d9e-872f-b841b631d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:40.078465 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51105f82-17cb-4d9e-872f-b841b631d8aa None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:40.079399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51105f82-17cb-4d9e-872f-b841b631d8aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:40.079930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51105f82-17cb-4d9e-872f-b841b631d8aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:40.081686 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51105f82-17cb-4d9e-872f-b841b631d8aa None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:40.104790 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 417/831] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:40.105663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51105f82-17cb-4d9e-872f-b841b631d8aa None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:40.209475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e101438-0af7-4289-9576-d62ad1293ae3 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:40.232373 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51105f82-17cb-4d9e-872f-b841b631d8aa None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:40.251142 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8080d-1ce6-49b3-a15d-3b1ea2c4d7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:40.251909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8080d-1ce6-49b3-a15d-3b1ea2c4d7ba None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:40.252195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8080d-1ce6-49b3-a15d-3b1ea2c4d7ba None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:40.252578 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8080d-1ce6-49b3-a15d-3b1ea2c4d7ba None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:40.253229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8080d-1ce6-49b3-a15d-3b1ea2c4d7ba None admin] RBAC: Adding query filter params (type=network) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:40.253536 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8080d-1ce6-49b3-a15d-3b1ea2c4d7ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:40.255013 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8080d-1ce6-49b3-a15d-3b1ea2c4d7ba None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:40.266084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 415/832] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:39:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:40.267275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8080d-1ce6-49b3-a15d-3b1ea2c4d7ba None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:40.273164 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaff86-2ea3-4f6c-a8b0-d26fbdbb0828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:40.273861 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaff86-2ea3-4f6c-a8b0-d26fbdbb0828 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:40.274141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaff86-2ea3-4f6c-a8b0-d26fbdbb0828 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:40.274410 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaff86-2ea3-4f6c-a8b0-d26fbdbb0828 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:40.285788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaff86-2ea3-4f6c-a8b0-d26fbdbb0828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-2afaff86-2ea3-4f6c-a8b0-d26fbdbb0828 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:40.291456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:40.292415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:40.293258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 418/833] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:40.295190 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaff86-2ea3-4f6c-a8b0-d26fbdbb0828 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:40.302787 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:40.367668 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:40.402644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8080d-1ce6-49b3-a15d-3b1ea2c4d7ba None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:40.416879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaff86-2ea3-4f6c-a8b0-d26fbdbb0828 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:40.447337 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40f268-abe8-4cc2-86bf-82fba5e0a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:40.447954 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40f268-abe8-4cc2-86bf-82fba5e0a53f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:40.448237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40f268-abe8-4cc2-86bf-82fba5e0a53f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:40.448507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40f268-abe8-4cc2-86bf-82fba5e0a53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:40.449487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40f268-abe8-4cc2-86bf-82fba5e0a53f None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=bfb0254e89514ff18e1c91dc427e4b1e) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:40.450319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40f268-abe8-4cc2-86bf-82fba5e0a53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:40.452709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40f268-abe8-4cc2-86bf-82fba5e0a53f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:40.459617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a912ef1-c7e3-4c5f-8fba-b27498212293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:40.460026 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 416/834] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:40 2022] GET /identity/v3/role_assignments?user.id=bfb0254e89514ff18e1c91dc427e4b1e&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:40.460773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a912ef1-c7e3-4c5f-8fba-b27498212293 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:40.460893 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40f268-abe8-4cc2-86bf-82fba5e0a53f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:40.461479 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a912ef1-c7e3-4c5f-8fba-b27498212293 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:40.461951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a912ef1-c7e3-4c5f-8fba-b27498212293 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:40.462822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a912ef1-c7e3-4c5f-8fba-b27498212293 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:40.465783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a912ef1-c7e3-4c5f-8fba-b27498212293 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:40.493295 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 419/835] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:39:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:40.583443 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:40.590012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40f268-abe8-4cc2-86bf-82fba5e0a53f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:40.647460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75d591-bab2-4d67-8b99-75c507765d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:40.648082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75d591-bab2-4d67-8b99-75c507765d3e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:40.648358 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75d591-bab2-4d67-8b99-75c507765d3e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:40.648630 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75d591-bab2-4d67-8b99-75c507765d3e None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:40.649294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75d591-bab2-4d67-8b99-75c507765d3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:40.649590 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75d591-bab2-4d67-8b99-75c507765d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:40.650988 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75d591-bab2-4d67-8b99-75c507765d3e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:40.667459 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 417/836] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:40.667645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a912ef1-c7e3-4c5f-8fba-b27498212293 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:40.795414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:40.809084 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a912ef1-c7e3-4c5f-8fba-b27498212293 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:40.865126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef270-51e2-4c6e-8062-0f84fd9bf419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:40.866691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef270-51e2-4c6e-8062-0f84fd9bf419 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:40.866999 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef270-51e2-4c6e-8062-0f84fd9bf419 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:40.867278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef270-51e2-4c6e-8062-0f84fd9bf419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:40.886729 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ef270-51e2-4c6e-8062-0f84fd9bf419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:40.889104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ef270-51e2-4c6e-8062-0f84fd9bf419 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-e02ef270-51e2-4c6e-8062-0f84fd9bf419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:40.904104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:40.905105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:40.906055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:40.906055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:40.906055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:40.906055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 420/837] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:40.913043 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75d591-bab2-4d67-8b99-75c507765d3e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:41.038850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75d591-bab2-4d67-8b99-75c507765d3e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:41.084259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94a425-72d3-485c-86a5-e566c3f74a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:41.085210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94a425-72d3-485c-86a5-e566c3f74a9f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:41.085718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94a425-72d3-485c-86a5-e566c3f74a9f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:41.086198 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94a425-72d3-485c-86a5-e566c3f74a9f None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:41.087104 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94a425-72d3-485c-86a5-e566c3f74a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:41.087686 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94a425-72d3-485c-86a5-e566c3f74a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:41.094970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94a425-72d3-485c-86a5-e566c3f74a9f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:41.102134 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 418/838] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:41.108484 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef270-51e2-4c6e-8062-0f84fd9bf419 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:41.218808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef270-51e2-4c6e-8062-0f84fd9bf419 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:41.253809 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb26828-815c-4a83-b259-e882fe46e30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:41.254431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb26828-815c-4a83-b259-e882fe46e30a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:41.254707 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb26828-815c-4a83-b259-e882fe46e30a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:41.254997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb26828-815c-4a83-b259-e882fe46e30a None admin] PATH_INFO: `/v3/users/swift` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:41.263068 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb26828-815c-4a83-b259-e882fe46e30a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:41.264669 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb26828-815c-4a83-b259-e882fe46e30a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-5cb26828-815c-4a83-b259-e882fe46e30a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:41.276122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:41.277289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:41.278568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 421/839] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:39:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:41.284510 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94a425-72d3-485c-86a5-e566c3f74a9f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:41.302620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:41.399013 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94a425-72d3-485c-86a5-e566c3f74a9f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:41.434369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054c308-7cfd-47ce-95bb-fcca454cd60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:41.435175 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054c308-7cfd-47ce-95bb-fcca454cd60b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:41.435462 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054c308-7cfd-47ce-95bb-fcca454cd60b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:41.435742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054c308-7cfd-47ce-95bb-fcca454cd60b None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:41.436536 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054c308-7cfd-47ce-95bb-fcca454cd60b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:41.436849 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054c308-7cfd-47ce-95bb-fcca454cd60b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:41.438278 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054c308-7cfd-47ce-95bb-fcca454cd60b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:41.456263 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 419/840] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Oct 3 14:39:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:41.461864 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb26828-815c-4a83-b259-e882fe46e30a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:41.478501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:41.578685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb26828-815c-4a83-b259-e882fe46e30a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:41.615337 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3ae9f-f8d1-4fad-8f81-8ec44037dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:41.615942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3ae9f-f8d1-4fad-8f81-8ec44037dd5e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:41.616219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3ae9f-f8d1-4fad-8f81-8ec44037dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:41.616540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3ae9f-f8d1-4fad-8f81-8ec44037dd5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:41.686661 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3ae9f-f8d1-4fad-8f81-8ec44037dd5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:41.688045 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3ae9f-f8d1-4fad-8f81-8ec44037dd5e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:41.697942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:41.795869 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 422/841] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:39:41.801559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054c308-7cfd-47ce-95bb-fcca454cd60b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:41.874843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:41.909762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054c308-7cfd-47ce-95bb-fcca454cd60b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:41.945009 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0050928-72d6-4a24-939a-df4ea972ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:41.945633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0050928-72d6-4a24-939a-df4ea972ad5a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:41.945858 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0050928-72d6-4a24-939a-df4ea972ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:41.946108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0050928-72d6-4a24-939a-df4ea972ad5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:41.957264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0050928-72d6-4a24-939a-df4ea972ad5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:41.958715 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0050928-72d6-4a24-939a-df4ea972ad5a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-a0050928-72d6-4a24-939a-df4ea972ad5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:41.974548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:41.975571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:41.976479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:41.976479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:41.976479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:41.976479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 420/842] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:41.984064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3ae9f-f8d1-4fad-8f81-8ec44037dd5e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:42.091084 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3ae9f-f8d1-4fad-8f81-8ec44037dd5e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:42.103038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:42.133423 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ce10d-0815-45ad-8559-7e586d1a2103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:42.134033 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ce10d-0815-45ad-8559-7e586d1a2103 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.134318 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ce10d-0815-45ad-8559-7e586d1a2103 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.134594 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ce10d-0815-45ad-8559-7e586d1a2103 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.135267 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ce10d-0815-45ad-8559-7e586d1a2103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:42.135573 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ce10d-0815-45ad-8559-7e586d1a2103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:42.136927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ce10d-0815-45ad-8559-7e586d1a2103 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:42.149370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 423/843] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:42.156109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0050928-72d6-4a24-939a-df4ea972ad5a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:42.266082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0050928-72d6-4a24-939a-df4ea972ad5a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:42.290393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:42.302351 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3c9b9-0bbc-4611-90a5-a3aaeb4dd447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:42.303013 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3c9b9-0bbc-4611-90a5-a3aaeb4dd447 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.303301 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3c9b9-0bbc-4611-90a5-a3aaeb4dd447 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.303585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3c9b9-0bbc-4611-90a5-a3aaeb4dd447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.310655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3c9b9-0bbc-4611-90a5-a3aaeb4dd447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:42.312136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3c9b9-0bbc-4611-90a5-a3aaeb4dd447 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-d0c3c9b9-0bbc-4611-90a5-a3aaeb4dd447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:42.323670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:42.324607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:42.325543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:42.325543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:42.325543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:42.325543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:42.325543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:42.325543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:42.325543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:42.325543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:42.325543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 421/844] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:42.332054 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ce10d-0815-45ad-8559-7e586d1a2103 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:42.356789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cd12c-49b6-4489-9d13-27862e9b2c9f None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.357420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cd12c-49b6-4489-9d13-27862e9b2c9f None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.357898 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cd12c-49b6-4489-9d13-27862e9b2c9f None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.359725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 422/845] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:42.364854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b94b22-6450-4577-ae38-6dfdfbbe7bd8 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.365204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b94b22-6450-4577-ae38-6dfdfbbe7bd8 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.365486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b94b22-6450-4577-ae38-6dfdfbbe7bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.384656 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-49b94b22-6450-4577-ae38-6dfdfbbe7bd8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:42.386161 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-49b94b22-6450-4577-ae38-6dfdfbbe7bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:42.455165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ce10d-0815-45ad-8559-7e586d1a2103 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:42.467270 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 423/846] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:42.491527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f748ce1-802e-4b31-a5e8-f5bdda5f6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:42.492139 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f748ce1-802e-4b31-a5e8-f5bdda5f6c8b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.492422 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f748ce1-802e-4b31-a5e8-f5bdda5f6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.492695 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f748ce1-802e-4b31-a5e8-f5bdda5f6c8b None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.493383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f748ce1-802e-4b31-a5e8-f5bdda5f6c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:42.493690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f748ce1-802e-4b31-a5e8-f5bdda5f6c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:42.495122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f748ce1-802e-4b31-a5e8-f5bdda5f6c8b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:42.508595 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 424/847] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:42.516036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b94b22-6450-4577-ae38-6dfdfbbe7bd8 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:42.625162 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b94b22-6450-4577-ae38-6dfdfbbe7bd8 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:42.640129 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:42.648733 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981be74-f34a-49a7-b463-223e6b14f273 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.649018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981be74-f34a-49a7-b463-223e6b14f273 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.649291 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981be74-f34a-49a7-b463-223e6b14f273 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.650746 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 425/848] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:42.657309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67d450-3884-401a-9c3c-1c86bd438263 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.657847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67d450-3884-401a-9c3c-1c86bd438263 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.658340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67d450-3884-401a-9c3c-1c86bd438263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.667060 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a57dd-5c38-472c-8c42-5c21f0e13af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:42.667681 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a57dd-5c38-472c-8c42-5c21f0e13af5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.667966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a57dd-5c38-472c-8c42-5c21f0e13af5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.668247 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a57dd-5c38-472c-8c42-5c21f0e13af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.669028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a57dd-5c38-472c-8c42-5c21f0e13af5 None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=29b7487e76304a87bd9d07d1f63b01d3) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:42.669448 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a57dd-5c38-472c-8c42-5c21f0e13af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:42.670910 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a57dd-5c38-472c-8c42-5c21f0e13af5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:42.682979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 424/849] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:42 2022] GET /identity/v3/role_assignments?user.id=29b7487e76304a87bd9d07d1f63b01d3&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:42.683165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-7a67d450-3884-401a-9c3c-1c86bd438263 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:42.683165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-7a67d450-3884-401a-9c3c-1c86bd438263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:42.726604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:42.748789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a57dd-5c38-472c-8c42-5c21f0e13af5 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:42.783289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 426/850] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:42.867841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665f35-ea96-4a42-8783-7f9027d50f12 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.868166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665f35-ea96-4a42-8783-7f9027d50f12 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.868392 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4665f35-ea96-4a42-8783-7f9027d50f12 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.870006 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 427/851] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:42.876458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658da89-837c-4e75-b3ae-06d00ef606bb None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.876749 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658da89-837c-4e75-b3ae-06d00ef606bb None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.876999 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658da89-837c-4e75-b3ae-06d00ef606bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.878642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a57dd-5c38-472c-8c42-5c21f0e13af5 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:42.897048 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-1658da89-837c-4e75-b3ae-06d00ef606bb None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:42.898235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-1658da89-837c-4e75-b3ae-06d00ef606bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:42.923786 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bbcaf-20ac-499b-8876-fd4a707edd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:42.924452 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bbcaf-20ac-499b-8876-fd4a707edd51 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:42.924738 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bbcaf-20ac-499b-8876-fd4a707edd51 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:42.925023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bbcaf-20ac-499b-8876-fd4a707edd51 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:42.925606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bbcaf-20ac-499b-8876-fd4a707edd51 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:42.927975 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bbcaf-20ac-499b-8876-fd4a707edd51 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c44bbcaf-20ac-499b-8876-fd4a707edd51 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:42.939303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:42.941101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:42.942135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 425/852] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:39:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:42.946271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bbcaf-20ac-499b-8876-fd4a707edd51 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:42.985059 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 428/853] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:42.995488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:43.054022 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bbcaf-20ac-499b-8876-fd4a707edd51 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:43.072029 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658da89-837c-4e75-b3ae-06d00ef606bb None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:43.094038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479b736-c207-45de-a8f7-4c14ccb0fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:43.094038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479b736-c207-45de-a8f7-4c14ccb0fefd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:43.094038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479b736-c207-45de-a8f7-4c14ccb0fefd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:43.094038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479b736-c207-45de-a8f7-4c14ccb0fefd None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:43.094399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479b736-c207-45de-a8f7-4c14ccb0fefd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:43.094616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479b736-c207-45de-a8f7-4c14ccb0fefd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:43.095932 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479b736-c207-45de-a8f7-4c14ccb0fefd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:43.102272 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 426/854] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:39:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:43.107611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479b736-c207-45de-a8f7-4c14ccb0fefd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:43.192946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:43.211871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658da89-837c-4e75-b3ae-06d00ef606bb None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:43.239428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479b736-c207-45de-a8f7-4c14ccb0fefd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:43.248171 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:43.251172 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd135b9-44aa-42ea-ab2d-c966b1c8c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:43.251937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd135b9-44aa-42ea-ab2d-c966b1c8c2f7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:43.252339 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd135b9-44aa-42ea-ab2d-c966b1c8c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:43.252684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd135b9-44aa-42ea-ab2d-c966b1c8c2f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:43.265304 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd135b9-44aa-42ea-ab2d-c966b1c8c2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-ecd135b9-44aa-42ea-ab2d-c966b1c8c2f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:43.270719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:43.271717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:43.273042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 429/855] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:43.277554 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd135b9-44aa-42ea-ab2d-c966b1c8c2f7 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:43.287076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c7a81-e9d3-42cc-8e13-4c73047e4ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:43.288142 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c7a81-e9d3-42cc-8e13-4c73047e4ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:43.288426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c7a81-e9d3-42cc-8e13-4c73047e4ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:43.288698 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c7a81-e9d3-42cc-8e13-4c73047e4ac5 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:43.289618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c7a81-e9d3-42cc-8e13-4c73047e4ac5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:43.289947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c7a81-e9d3-42cc-8e13-4c73047e4ac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:43.291341 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c7a81-e9d3-42cc-8e13-4c73047e4ac5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:43.296311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 427/856] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:39:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:43.304308 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c7a81-e9d3-42cc-8e13-4c73047e4ac5 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:43.412240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd135b9-44aa-42ea-ab2d-c966b1c8c2f7 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:43.429321 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c7a81-e9d3-42cc-8e13-4c73047e4ac5 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:43.458292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6f2cf-94c7-4b1f-beb0-52bb45592480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:43.459429 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6f2cf-94c7-4b1f-beb0-52bb45592480 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:43.459712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6f2cf-94c7-4b1f-beb0-52bb45592480 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:43.459989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6f2cf-94c7-4b1f-beb0-52bb45592480 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:43.460975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6f2cf-94c7-4b1f-beb0-52bb45592480 None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:43.461286 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6f2cf-94c7-4b1f-beb0-52bb45592480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:43.462809 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6f2cf-94c7-4b1f-beb0-52bb45592480 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:43.478025 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 430/857] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:43.479187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de0e7f-495c-47d8-919c-605c13da58b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:43.479317 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6f2cf-94c7-4b1f-beb0-52bb45592480 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:43.480217 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de0e7f-495c-47d8-919c-605c13da58b5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:43.480698 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de0e7f-495c-47d8-919c-605c13da58b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:43.481743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de0e7f-495c-47d8-919c-605c13da58b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:43.482893 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de0e7f-495c-47d8-919c-605c13da58b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:43.485545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de0e7f-495c-47d8-919c-605c13da58b5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:43.496123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e3de0e7f-495c-47d8-919c-605c13da58b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:43.499412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:43.500342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 14:39:43.501229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:43.504293 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 428/858] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Oct 3 14:39:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:43.511037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de0e7f-495c-47d8-919c-605c13da58b5 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:43.553689 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:43.619106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6f2cf-94c7-4b1f-beb0-52bb45592480 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:43.646628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de0e7f-495c-47d8-919c-605c13da58b5 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:43.660643 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669a857-7a2b-421e-b1ef-8840b42c9c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:43.661287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669a857-7a2b-421e-b1ef-8840b42c9c54 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:43.661570 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669a857-7a2b-421e-b1ef-8840b42c9c54 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:43.661898 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669a857-7a2b-421e-b1ef-8840b42c9c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:43.674069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669a857-7a2b-421e-b1ef-8840b42c9c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:43.675549 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669a857-7a2b-421e-b1ef-8840b42c9c54 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:43.689290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26245f3f-cace-4fcb-a5b9-3bf6a6d0e9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:43.689925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245f3f-cace-4fcb-a5b9-3bf6a6d0e9d2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:43.690254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245f3f-cace-4fcb-a5b9-3bf6a6d0e9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:43.690534 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26245f3f-cace-4fcb-a5b9-3bf6a6d0e9d2 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:43.691216 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26245f3f-cace-4fcb-a5b9-3bf6a6d0e9d2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:43.691525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26245f3f-cace-4fcb-a5b9-3bf6a6d0e9d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:43.693265 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26245f3f-cace-4fcb-a5b9-3bf6a6d0e9d2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-8669a857-7a2b-421e-b1ef-8840b42c9c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:43.693635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:43.694552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:43.695470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:43.695470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:43.695470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:43.699636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 431/860] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:43.700816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669a857-7a2b-421e-b1ef-8840b42c9c54 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:43.701257 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 429/860] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:43.705091 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26245f3f-cace-4fcb-a5b9-3bf6a6d0e9d2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:43.776916 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:43.817721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26245f3f-cace-4fcb-a5b9-3bf6a6d0e9d2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:43.823810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669a857-7a2b-421e-b1ef-8840b42c9c54 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:43.826372 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:43.855836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5529c-825f-4af0-92c7-b8221d21ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:43.856999 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5529c-825f-4af0-92c7-b8221d21ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:43.857485 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5529c-825f-4af0-92c7-b8221d21ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:43.857982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5529c-825f-4af0-92c7-b8221d21ffe4 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:43.858923 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5529c-825f-4af0-92c7-b8221d21ffe4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:43.859721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5529c-825f-4af0-92c7-b8221d21ffe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:43.861275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5529c-825f-4af0-92c7-b8221d21ffe4 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:43.865325 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942756-ba82-4981-bc0a-cc25eb9d2976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:43.865941 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942756-ba82-4981-bc0a-cc25eb9d2976 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:43.866225 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942756-ba82-4981-bc0a-cc25eb9d2976 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:43.866503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942756-ba82-4981-bc0a-cc25eb9d2976 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:43.867189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0942756-ba82-4981-bc0a-cc25eb9d2976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:43.867610 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0942756-ba82-4981-bc0a-cc25eb9d2976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:43.868048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 430/861] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:43.873020 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0942756-ba82-4981-bc0a-cc25eb9d2976 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:43.887584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 432/862] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:43.894068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5529c-825f-4af0-92c7-b8221d21ffe4 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:44.015916 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5529c-825f-4af0-92c7-b8221d21ffe4 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:44.056736 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd8b27-9b75-4311-8473-04983c6a33bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:44.057780 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd8b27-9b75-4311-8473-04983c6a33bd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:44.058280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd8b27-9b75-4311-8473-04983c6a33bd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:44.058611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd8b27-9b75-4311-8473-04983c6a33bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:44.067097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd8b27-9b75-4311-8473-04983c6a33bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:44.068566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd8b27-9b75-4311-8473-04983c6a33bd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-78dd8b27-9b75-4311-8473-04983c6a33bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:44.081600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:44.082611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:44.084389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 431/863] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:39:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:44.088821 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942756-ba82-4981-bc0a-cc25eb9d2976 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:44.209454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942756-ba82-4981-bc0a-cc25eb9d2976 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:44.234637 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:44.248011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295466c-f3a8-498a-bab7-d5b0943ae156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:44.248627 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295466c-f3a8-498a-bab7-d5b0943ae156 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:44.248913 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295466c-f3a8-498a-bab7-d5b0943ae156 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:44.249191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295466c-f3a8-498a-bab7-d5b0943ae156 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:44.249926 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295466c-f3a8-498a-bab7-d5b0943ae156 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:44.250234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295466c-f3a8-498a-bab7-d5b0943ae156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:44.251970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295466c-f3a8-498a-bab7-d5b0943ae156 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:44.273546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 433/864] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Oct 3 14:39:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:44.279413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd8b27-9b75-4311-8473-04983c6a33bd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:44.305353 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:44.384425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd8b27-9b75-4311-8473-04983c6a33bd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:44.419398 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd89e6-0010-416d-8a27-9150e7bf6d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:44.420017 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd89e6-0010-416d-8a27-9150e7bf6d2b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:44.420300 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd89e6-0010-416d-8a27-9150e7bf6d2b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:44.420633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd89e6-0010-416d-8a27-9150e7bf6d2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:44.491013 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd89e6-0010-416d-8a27-9150e7bf6d2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:44.492458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd89e6-0010-416d-8a27-9150e7bf6d2b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:44.516869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:44.602540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 432/865] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:39:44.608567 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295466c-f3a8-498a-bab7-d5b0943ae156 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:44.717559 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295466c-f3a8-498a-bab7-d5b0943ae156 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:44.760904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51de401-4420-44b3-a9ae-c45ed7905d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:44.761541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51de401-4420-44b3-a9ae-c45ed7905d9a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:44.761825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51de401-4420-44b3-a9ae-c45ed7905d9a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:44.762102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51de401-4420-44b3-a9ae-c45ed7905d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:44.775196 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51de401-4420-44b3-a9ae-c45ed7905d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:44.776634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51de401-4420-44b3-a9ae-c45ed7905d9a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-a51de401-4420-44b3-a9ae-c45ed7905d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:44.792360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:44.793762 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:44.794649 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:44.794649 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:44.794649 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:44.794649 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 434/866] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:44.799774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd89e6-0010-416d-8a27-9150e7bf6d2b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:44.915861 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd89e6-0010-416d-8a27-9150e7bf6d2b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:44.945370 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:44.960654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f2fe8-44d7-4121-bd69-6181d8342c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:44.961290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f2fe8-44d7-4121-bd69-6181d8342c0f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:44.961573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f2fe8-44d7-4121-bd69-6181d8342c0f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:44.961849 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f2fe8-44d7-4121-bd69-6181d8342c0f None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:44.962511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f2fe8-44d7-4121-bd69-6181d8342c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:44.962815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f2fe8-44d7-4121-bd69-6181d8342c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:44.964327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f2fe8-44d7-4121-bd69-6181d8342c0f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:44.977681 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 433/867] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:44.984400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51de401-4420-44b3-a9ae-c45ed7905d9a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:44.991475 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87ebe2-2685-45e8-8061-f285d6e3098c None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:44.991762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87ebe2-2685-45e8-8061-f285d6e3098c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:44.992039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87ebe2-2685-45e8-8061-f285d6e3098c None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:44.993583 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 434/868] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:44.999558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93281384-01d0-440b-b8d0-436ceab2c341 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:44.999841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93281384-01d0-440b-b8d0-436ceab2c341 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:45.000119 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93281384-01d0-440b-b8d0-436ceab2c341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:45.020515 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-93281384-01d0-440b-b8d0-436ceab2c341 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:45.021703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:45.021884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-93281384-01d0-440b-b8d0-436ceab2c341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:45.111039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 435/869] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:45.116961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51de401-4420-44b3-a9ae-c45ed7905d9a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:45.151956 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202f201-5e95-41b3-a544-fe4524cb5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:45.152585 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f201-5e95-41b3-a544-fe4524cb5802 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:45.153387 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f201-5e95-41b3-a544-fe4524cb5802 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:45.153713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202f201-5e95-41b3-a544-fe4524cb5802 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:45.160707 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202f201-5e95-41b3-a544-fe4524cb5802 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:45.162194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202f201-5e95-41b3-a544-fe4524cb5802 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-a202f201-5e95-41b3-a544-fe4524cb5802 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:45.173444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:45.174329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:45.175265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:45.175265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:45.175265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:45.175265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:45.175265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:45.175265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:45.175265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:45.175265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:45.175265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 435/870] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:45.180187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93281384-01d0-440b-b8d0-436ceab2c341 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:45.290730 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93281384-01d0-440b-b8d0-436ceab2c341 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:45.304699 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:45.327899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beee1db-64a2-462a-beee-cbfaa026f2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:45.328800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beee1db-64a2-462a-beee-cbfaa026f2ba None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:45.329262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beee1db-64a2-462a-beee-cbfaa026f2ba None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:45.329709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beee1db-64a2-462a-beee-cbfaa026f2ba None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:45.330598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beee1db-64a2-462a-beee-cbfaa026f2ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:45.331144 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beee1db-64a2-462a-beee-cbfaa026f2ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:45.332782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beee1db-64a2-462a-beee-cbfaa026f2ba None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:45.345950 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 436/871] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:45.351503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202f201-5e95-41b3-a544-fe4524cb5802 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:45.397427 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beee1db-64a2-462a-beee-cbfaa026f2ba None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:45.460975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:45.473235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202f201-5e95-41b3-a544-fe4524cb5802 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:45.513140 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba9844-5ef4-41ed-aab1-32532239e38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:45.514015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba9844-5ef4-41ed-aab1-32532239e38d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:45.514441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba9844-5ef4-41ed-aab1-32532239e38d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:45.515035 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba9844-5ef4-41ed-aab1-32532239e38d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:45.516023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba9844-5ef4-41ed-aab1-32532239e38d None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=48ba8f16b64e4625866d7052846d906a) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:45.516500 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba9844-5ef4-41ed-aab1-32532239e38d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:45.518244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba9844-5ef4-41ed-aab1-32532239e38d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:45.525593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 436/872] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:45 2022] GET /identity/v3/role_assignments?user.id=48ba8f16b64e4625866d7052846d906a&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:45.543235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beee1db-64a2-462a-beee-cbfaa026f2ba None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:45.583747 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fc051-43f1-4a7c-a125-f42782dc8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:45.584652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fc051-43f1-4a7c-a125-f42782dc8151 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:45.585079 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fc051-43f1-4a7c-a125-f42782dc8151 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:45.585520 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fc051-43f1-4a7c-a125-f42782dc8151 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:45.586259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fc051-43f1-4a7c-a125-f42782dc8151 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:45.587834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fc051-43f1-4a7c-a125-f42782dc8151 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-572fc051-43f1-4a7c-a125-f42782dc8151 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:45.598151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:45.599457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:45.600436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:45.602864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 437/873] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:45.609785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba9844-5ef4-41ed-aab1-32532239e38d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:45.623600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38118f-66a9-4ce8-a6d6-fd2993a09c46 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:45.623887 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38118f-66a9-4ce8-a6d6-fd2993a09c46 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:45.624168 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38118f-66a9-4ce8-a6d6-fd2993a09c46 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:45.626064 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 438/874] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:45.632406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfa00f-6b07-49bd-8959-8c531674424c None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:45.632688 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfa00f-6b07-49bd-8959-8c531674424c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:45.632970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfa00f-6b07-49bd-8959-8c531674424c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:45.654502 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a1dfa00f-6b07-49bd-8959-8c531674424c None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:45.656114 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a1dfa00f-6b07-49bd-8959-8c531674424c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:45.696976 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:45.737951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba9844-5ef4-41ed-aab1-32532239e38d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:45.747147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 439/875] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:45.775574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fa51b-4a89-462f-858d-e9997ee13d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:45.776229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fa51b-4a89-462f-858d-e9997ee13d07 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:45.776557 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fa51b-4a89-462f-858d-e9997ee13d07 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:45.776776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fa51b-4a89-462f-858d-e9997ee13d07 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:45.777450 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fa51b-4a89-462f-858d-e9997ee13d07 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:45.777800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fa51b-4a89-462f-858d-e9997ee13d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:45.779189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fa51b-4a89-462f-858d-e9997ee13d07 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:45.784168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 437/876] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:39:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:45.789616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfa00f-6b07-49bd-8959-8c531674424c None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:45.895094 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfa00f-6b07-49bd-8959-8c531674424c None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:45.930435 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecc10f-e1d9-4eb0-9ba6-2ecec204fd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:45.931072 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecc10f-e1d9-4eb0-9ba6-2ecec204fd26 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:45.931405 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecc10f-e1d9-4eb0-9ba6-2ecec204fd26 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:45.931679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecc10f-e1d9-4eb0-9ba6-2ecec204fd26 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:45.932347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecc10f-e1d9-4eb0-9ba6-2ecec204fd26 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:45.932652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecc10f-e1d9-4eb0-9ba6-2ecec204fd26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:45.934535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecc10f-e1d9-4eb0-9ba6-2ecec204fd26 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:45.939532 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 440/877] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:39:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:46.019261 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fa51b-4a89-462f-858d-e9997ee13d07 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:46.044351 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:46.135238 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fa51b-4a89-462f-858d-e9997ee13d07 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:46.175038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fade76-7f3f-4178-b8e1-055b12da088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:46.175977 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fade76-7f3f-4178-b8e1-055b12da088d None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:46.176465 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fade76-7f3f-4178-b8e1-055b12da088d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:46.176936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fade76-7f3f-4178-b8e1-055b12da088d None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:46.177810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fade76-7f3f-4178-b8e1-055b12da088d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:46.179431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fade76-7f3f-4178-b8e1-055b12da088d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:46.195838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 438/878] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:39:46 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:46.356670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628c218-1992-49e6-b6b5-0443b8649cee None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:46.357215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628c218-1992-49e6-b6b5-0443b8649cee None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:46.357215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628c218-1992-49e6-b6b5-0443b8649cee None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:46.358831 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 441/879] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:46.364492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34009274-5f8f-408b-85b5-2880918e812b None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:46.364795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34009274-5f8f-408b-85b5-2880918e812b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:46.365052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34009274-5f8f-408b-85b5-2880918e812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:46.385087 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-34009274-5f8f-408b-85b5-2880918e812b None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:46.386285 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-34009274-5f8f-408b-85b5-2880918e812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:46.467596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 439/880] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:46.742392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628c218-1992-49e6-b6b5-0443b8649cee None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:46.776510 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:46.851404 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628c218-1992-49e6-b6b5-0443b8649cee None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:46.886114 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac8cb8-c046-49f2-bbae-b51c7bf5a82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:46.886718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac8cb8-c046-49f2-bbae-b51c7bf5a82d None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:46.887057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac8cb8-c046-49f2-bbae-b51c7bf5a82d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:46.887415 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac8cb8-c046-49f2-bbae-b51c7bf5a82d None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:46.888126 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac8cb8-c046-49f2-bbae-b51c7bf5a82d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:46.889470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac8cb8-c046-49f2-bbae-b51c7bf5a82d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:46.911846 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 442/881] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:39:46 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:47.908848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f6cba-510f-4d07-8de4-b4b11609e1bd None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:47.909406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f6cba-510f-4d07-8de4-b4b11609e1bd None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:47.909406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f6cba-510f-4d07-8de4-b4b11609e1bd None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:47.910879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 440/882] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:47.916276 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625107a5-ab43-4cf2-b9f7-15c5ae77aa44 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:47.916682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625107a5-ab43-4cf2-b9f7-15c5ae77aa44 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:47.916871 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625107a5-ab43-4cf2-b9f7-15c5ae77aa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:47.936912 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-625107a5-ab43-4cf2-b9f7-15c5ae77aa44 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:47.938147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-625107a5-ab43-4cf2-b9f7-15c5ae77aa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:48.012900 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 443/883] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:48.233837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48510-6c78-4ead-a721-8d7f37525bd8 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:48.234023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48510-6c78-4ead-a721-8d7f37525bd8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:48.234289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48510-6c78-4ead-a721-8d7f37525bd8 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:48.236120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 441/884] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:48.241530 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204eaa-6697-47cb-82be-04c9c18ed692 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:48.242046 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204eaa-6697-47cb-82be-04c9c18ed692 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:48.242540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204eaa-6697-47cb-82be-04c9c18ed692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:48.261810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-96204eaa-6697-47cb-82be-04c9c18ed692 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:48.263947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-96204eaa-6697-47cb-82be-04c9c18ed692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:48.275501 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:48.292361 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48510-6c78-4ead-a721-8d7f37525bd8 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:48.303220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:48.337603 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 444/885] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:48.423547 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48510-6c78-4ead-a721-8d7f37525bd8 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:48.461966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc691b-0cce-4c24-a546-5b726b88ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:48.462593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc691b-0cce-4c24-a546-5b726b88ffeb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:48.462873 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc691b-0cce-4c24-a546-5b726b88ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:48.463174 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc691b-0cce-4c24-a546-5b726b88ffeb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:48.474222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc691b-0cce-4c24-a546-5b726b88ffeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-20fc691b-0cce-4c24-a546-5b726b88ffeb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:48.479039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:48.480049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:48.481524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 442/886] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Oct 3 14:39:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:48.488521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204eaa-6697-47cb-82be-04c9c18ed692 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:48.499933 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8124294-f9ee-4b81-8234-0f79cd315d00 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:48.500205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8124294-f9ee-4b81-8234-0f79cd315d00 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:48.500483 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8124294-f9ee-4b81-8234-0f79cd315d00 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:48.502404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 443/887] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:48.507294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628b473-c93d-4676-88ae-f7384b439382 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:48.507528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628b473-c93d-4676-88ae-f7384b439382 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:48.507735 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628b473-c93d-4676-88ae-f7384b439382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:48.526448 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-0628b473-c93d-4676-88ae-f7384b439382 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:48.527988 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-0628b473-c93d-4676-88ae-f7384b439382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:48.599050 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204eaa-6697-47cb-82be-04c9c18ed692 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:48.599400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:48.610906 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 444/888] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:48.611675 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628b473-c93d-4676-88ae-f7384b439382 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:48.639586 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ad079-77f7-415d-9535-5ae60e96c440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:48.640840 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ad079-77f7-415d-9535-5ae60e96c440 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:48.641641 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ad079-77f7-415d-9535-5ae60e96c440 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:48.642088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ad079-77f7-415d-9535-5ae60e96c440 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:48.643080 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ad079-77f7-415d-9535-5ae60e96c440 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:48.643837 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ad079-77f7-415d-9535-5ae60e96c440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:48.645848 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ad079-77f7-415d-9535-5ae60e96c440 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:48.661746 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 445/889] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Oct 3 14:39:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:48.662348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ad079-77f7-415d-9535-5ae60e96c440 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:48.678707 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:48.729118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628b473-c93d-4676-88ae-f7384b439382 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:48.768754 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5fd61-bb1e-4893-ac07-a6721af5fffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:48.769076 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5fd61-bb1e-4893-ac07-a6721af5fffc None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:48.769355 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5fd61-bb1e-4893-ac07-a6721af5fffc None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:48.769629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5fd61-bb1e-4893-ac07-a6721af5fffc None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:48.770277 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5fd61-bb1e-4893-ac07-a6721af5fffc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:48.771802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5fd61-bb1e-4893-ac07-a6721af5fffc None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:48.803186 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 445/890] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:39:48 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:48.807993 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ad079-77f7-415d-9535-5ae60e96c440 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:48.857589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c32da-94ba-4e37-93cd-350f11a64ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:48.858680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c32da-94ba-4e37-93cd-350f11a64ac1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:48.859392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c32da-94ba-4e37-93cd-350f11a64ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:48.859875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c32da-94ba-4e37-93cd-350f11a64ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:48.874712 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c32da-94ba-4e37-93cd-350f11a64ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:48.876755 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c32da-94ba-4e37-93cd-350f11a64ac1 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-b07c32da-94ba-4e37-93cd-350f11a64ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:48.894828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:48.895973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:48.896868 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:48.896868 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:48.896868 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:48.903510 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 446/891] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:48.904971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5fd61-bb1e-4893-ac07-a6721af5fffc None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:48.907633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c32da-94ba-4e37-93cd-350f11a64ac1 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:48.975774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:48.979758 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:49.032576 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c32da-94ba-4e37-93cd-350f11a64ac1 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:49.042398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5fd61-bb1e-4893-ac07-a6721af5fffc None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:49.077373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375bab5-2611-43c8-b56f-9a1b83ab88b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:49.078009 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375bab5-2611-43c8-b56f-9a1b83ab88b4 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.078294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375bab5-2611-43c8-b56f-9a1b83ab88b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.078569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375bab5-2611-43c8-b56f-9a1b83ab88b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.079389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375bab5-2611-43c8-b56f-9a1b83ab88b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:49.079700 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375bab5-2611-43c8-b56f-9a1b83ab88b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:49.081226 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375bab5-2611-43c8-b56f-9a1b83ab88b4 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:49.097400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a720eb-ae44-4d95-806a-8d097f3b036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:49.098189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a720eb-ae44-4d95-806a-8d097f3b036f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.098564 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a720eb-ae44-4d95-806a-8d097f3b036f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.098935 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a720eb-ae44-4d95-806a-8d097f3b036f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.099645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a720eb-ae44-4d95-806a-8d097f3b036f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:49.101084 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a720eb-ae44-4d95-806a-8d097f3b036f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:49.109263 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 447/892] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-40a720eb-ae44-4d95-806a-8d097f3b036f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:49.113561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:49.114597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:49.115528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 446/893] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:39:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:49.118450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375bab5-2611-43c8-b56f-9a1b83ab88b4 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:49.119508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a720eb-ae44-4d95-806a-8d097f3b036f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:49.232807 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375bab5-2611-43c8-b56f-9a1b83ab88b4 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:49.245672 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a720eb-ae44-4d95-806a-8d097f3b036f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:49.251304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:49.267738 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:49.272961 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e575f-2335-426a-983f-65bc46907b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:49.273604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e575f-2335-426a-983f-65bc46907b78 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.273883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e575f-2335-426a-983f-65bc46907b78 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.274155 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e575f-2335-426a-983f-65bc46907b78 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.281738 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e575f-2335-426a-983f-65bc46907b78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:49.283245 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e575f-2335-426a-983f-65bc46907b78 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:49.284560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7bc4-958d-457e-a7d0-906562b01983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:49.286191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7bc4-958d-457e-a7d0-906562b01983 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.286652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7bc4-958d-457e-a7d0-906562b01983 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.287145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7bc4-958d-457e-a7d0-906562b01983 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.287940 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7bc4-958d-457e-a7d0-906562b01983 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:49.288415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7bc4-958d-457e-a7d0-906562b01983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:49.290217 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7bc4-958d-457e-a7d0-906562b01983 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:49.295761 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 447/894] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:39:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-c93e575f-2335-426a-983f-65bc46907b78 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:49.295899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:49.296792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:49.297749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:49.299942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5b3a-6e9e-4615-baf5-91bd338e9220 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.300402 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5b3a-6e9e-4615-baf5-91bd338e9220 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.300849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5b3a-6e9e-4615-baf5-91bd338e9220 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.301700 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 448/895] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:39:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:49.302450 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 448/896] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:49.302555 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e575f-2335-426a-983f-65bc46907b78 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:49.303417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b5b3a-6e9e-4615-baf5-91bd338e9220 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:49.409111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e575f-2335-426a-983f-65bc46907b78 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:49.414516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b5b3a-6e9e-4615-baf5-91bd338e9220 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:49.447478 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56175f89-75ea-4e6a-9f9e-9c4ad1d5acbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:49.448056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175f89-75ea-4e6a-9f9e-9c4ad1d5acbc None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.448338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175f89-75ea-4e6a-9f9e-9c4ad1d5acbc None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.448612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56175f89-75ea-4e6a-9f9e-9c4ad1d5acbc None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.448710 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d2f91-7665-468e-b92e-66e599d820f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:49.449225 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d2f91-7665-468e-b92e-66e599d820f1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.449320 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56175f89-75ea-4e6a-9f9e-9c4ad1d5acbc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:49.450212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56175f89-75ea-4e6a-9f9e-9c4ad1d5acbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:49.450315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d2f91-7665-468e-b92e-66e599d820f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.450571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d2f91-7665-468e-b92e-66e599d820f1 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.451258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d2f91-7665-468e-b92e-66e599d820f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:49.451562 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d2f91-7665-468e-b92e-66e599d820f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:49.452025 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56175f89-75ea-4e6a-9f9e-9c4ad1d5acbc None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:49.452899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d2f91-7665-468e-b92e-66e599d820f1 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:49.458221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 449/897] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:39:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:49.460441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aa189-3dc5-4954-a0ec-ef9dd48a8296 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.461102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aa189-3dc5-4954-a0ec-ef9dd48a8296 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.462539 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aa189-3dc5-4954-a0ec-ef9dd48a8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.470797 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 449/898] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Oct 3 14:39:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:49.471231 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56175f89-75ea-4e6a-9f9e-9c4ad1d5acbc None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:49.482892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-929aa189-3dc5-4954-a0ec-ef9dd48a8296 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:49.484725 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-929aa189-3dc5-4954-a0ec-ef9dd48a8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:49.508830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:49.536057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:49.566994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 450/899] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:49.566994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aa189-3dc5-4954-a0ec-ef9dd48a8296 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:49.584564 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56175f89-75ea-4e6a-9f9e-9c4ad1d5acbc None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:49.620642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385106e-9746-4fe6-92a6-240ff454594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:49.622027 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385106e-9746-4fe6-92a6-240ff454594a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.622684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385106e-9746-4fe6-92a6-240ff454594a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.623279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385106e-9746-4fe6-92a6-240ff454594a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.624138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385106e-9746-4fe6-92a6-240ff454594a None admin] RBAC: Adding query filter params (interface=public, service_id=13f80a92507d4a6dbebd7e33b4be23b2, region_id=RegionOne) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:49.624597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385106e-9746-4fe6-92a6-240ff454594a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:49.626185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385106e-9746-4fe6-92a6-240ff454594a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:49.631824 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 450/900] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Oct 3 14:39:49 2022] GET /identity/v3/endpoints?service_id=13f80a92507d4a6dbebd7e33b4be23b2&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:49.638574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385106e-9746-4fe6-92a6-240ff454594a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:49.694223 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aa189-3dc5-4954-a0ec-ef9dd48a8296 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:49.737229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ff216-54bb-4917-a7fd-35538f37f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:49.738501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ff216-54bb-4917-a7fd-35538f37f39c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.739037 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ff216-54bb-4917-a7fd-35538f37f39c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.739825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ff216-54bb-4917-a7fd-35538f37f39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.747466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:49.751869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385106e-9746-4fe6-92a6-240ff454594a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:49.795159 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cd3e-05e4-454b-a49a-9cf2e7ff06e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:49.796649 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cd3e-05e4-454b-a49a-9cf2e7ff06e1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:49.797154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cd3e-05e4-454b-a49a-9cf2e7ff06e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:49.797625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cd3e-05e4-454b-a49a-9cf2e7ff06e1 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:49.798556 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0cd3e-05e4-454b-a49a-9cf2e7ff06e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:49.798929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:49.800997 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0cd3e-05e4-454b-a49a-9cf2e7ff06e1 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:49.814983 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 451/901] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Oct 3 14:39:49 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 14:39:49.832786 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ff216-54bb-4917-a7fd-35538f37f39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:49.834311 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ff216-54bb-4917-a7fd-35538f37f39c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:49.877445 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cd3e-05e4-454b-a49a-9cf2e7ff06e1 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:49.955174 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 451/902] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:39:49 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:39:49.961102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ff216-54bb-4917-a7fd-35538f37f39c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:50.009804 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cd3e-05e4-454b-a49a-9cf2e7ff06e1 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.054460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d910c-e144-4db0-b42a-b8cf6983b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.055373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d910c-e144-4db0-b42a-b8cf6983b016 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.055804 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d910c-e144-4db0-b42a-b8cf6983b016 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.056080 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d910c-e144-4db0-b42a-b8cf6983b016 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.056689 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d910c-e144-4db0-b42a-b8cf6983b016 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.058243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d910c-e144-4db0-b42a-b8cf6983b016 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.060144 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-4e8d910c-e144-4db0-b42a-b8cf6983b016 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:50.070214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:50.071252 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:50.072127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 452/903] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Oct 3 14:39:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:50.078396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d910c-e144-4db0-b42a-b8cf6983b016 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:50.098819 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ff216-54bb-4917-a7fd-35538f37f39c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.125390 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:50.140888 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f9d24-e248-4376-a734-561eb9d37bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.141784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f9d24-e248-4376-a734-561eb9d37bcd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.142307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f9d24-e248-4376-a734-561eb9d37bcd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.142721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f9d24-e248-4376-a734-561eb9d37bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.154750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f9d24-e248-4376-a734-561eb9d37bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.156558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f9d24-e248-4376-a734-561eb9d37bcd None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-845f9d24-e248-4376-a734-561eb9d37bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:50.180125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:50.181235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:50.182131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:50.182131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:50.182131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:50.185035 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 452/904] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:50.191049 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f9d24-e248-4376-a734-561eb9d37bcd None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:50.209890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d910c-e144-4db0-b42a-b8cf6983b016 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.247841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225c3c3-990c-488f-8139-c0a791cef481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.248484 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225c3c3-990c-488f-8139-c0a791cef481 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.248767 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225c3c3-990c-488f-8139-c0a791cef481 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.249130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225c3c3-990c-488f-8139-c0a791cef481 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.249658 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225c3c3-990c-488f-8139-c0a791cef481 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:50.249964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225c3c3-990c-488f-8139-c0a791cef481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.251428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225c3c3-990c-488f-8139-c0a791cef481 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.261492 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 453/905] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:50.262992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225c3c3-990c-488f-8139-c0a791cef481 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:50.316920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f9d24-e248-4376-a734-561eb9d37bcd None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.348509 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:50.355059 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de63ad-d5cd-4572-81ec-9cff0909e3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.357084 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de63ad-d5cd-4572-81ec-9cff0909e3eb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.357617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de63ad-d5cd-4572-81ec-9cff0909e3eb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.358305 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de63ad-d5cd-4572-81ec-9cff0909e3eb None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.359281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de63ad-d5cd-4572-81ec-9cff0909e3eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:50.359683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de63ad-d5cd-4572-81ec-9cff0909e3eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.361535 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de63ad-d5cd-4572-81ec-9cff0909e3eb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.376729 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:50.379289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 453/906] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:50.385110 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de63ad-d5cd-4572-81ec-9cff0909e3eb None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:50.390575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225c3c3-990c-488f-8139-c0a791cef481 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.433970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27a07-b41e-4a75-bf08-4f1914d777da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.434589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27a07-b41e-4a75-bf08-4f1914d777da None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.434868 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27a07-b41e-4a75-bf08-4f1914d777da None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.435295 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27a07-b41e-4a75-bf08-4f1914d777da None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.436250 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27a07-b41e-4a75-bf08-4f1914d777da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:50.436640 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27a07-b41e-4a75-bf08-4f1914d777da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.438249 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27a07-b41e-4a75-bf08-4f1914d777da None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.449103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 454/907] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:50.450782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27a07-b41e-4a75-bf08-4f1914d777da None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:50.510926 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de63ad-d5cd-4572-81ec-9cff0909e3eb None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.559556 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521201bb-34cf-4063-a967-ae81310a430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.560190 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521201bb-34cf-4063-a967-ae81310a430f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.560468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521201bb-34cf-4063-a967-ae81310a430f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.560741 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521201bb-34cf-4063-a967-ae81310a430f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.561517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27a07-b41e-4a75-bf08-4f1914d777da None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.569187 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521201bb-34cf-4063-a967-ae81310a430f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.571274 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521201bb-34cf-4063-a967-ae81310a430f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-521201bb-34cf-4063-a967-ae81310a430f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:50.588175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:50.589155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:50.590620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:50.590620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:50.590620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:50.590620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:50.590620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:50.590620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:50.590620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:50.590620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:50.595089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 454/908] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:50.596379 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521201bb-34cf-4063-a967-ae81310a430f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:50.604339 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4e462-ed7b-491b-b812-31fc38581e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.605346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4e462-ed7b-491b-b812-31fc38581e10 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.605908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4e462-ed7b-491b-b812-31fc38581e10 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.606434 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4e462-ed7b-491b-b812-31fc38581e10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.607367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4e462-ed7b-491b-b812-31fc38581e10 None admin] RBAC: Adding query filter params (interface=public, service_id=cd6c744359bb42ffa03894793a67dd20, region_id=RegionOne) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:50.607900 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4e462-ed7b-491b-b812-31fc38581e10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.609463 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4e462-ed7b-491b-b812-31fc38581e10 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.620439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 455/909] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Oct 3 14:39:50 2022] GET /identity/v3/endpoints?service_id=cd6c744359bb42ffa03894793a67dd20&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:50.622685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4e462-ed7b-491b-b812-31fc38581e10 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:50.642747 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:50.659552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:50.714567 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521201bb-34cf-4063-a967-ae81310a430f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.751050 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29367d24-d213-4d16-b0c5-92e95357d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.752092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29367d24-d213-4d16-b0c5-92e95357d847 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.752576 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29367d24-d213-4d16-b0c5-92e95357d847 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.752810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4e462-ed7b-491b-b812-31fc38581e10 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.753265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29367d24-d213-4d16-b0c5-92e95357d847 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.754150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29367d24-d213-4d16-b0c5-92e95357d847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:50.754825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29367d24-d213-4d16-b0c5-92e95357d847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.756623 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29367d24-d213-4d16-b0c5-92e95357d847 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.771888 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 455/910] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:50.777951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29367d24-d213-4d16-b0c5-92e95357d847 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:50.806402 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bb3ca-00c8-46d8-8828-870814b35641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.807914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb3ca-00c8-46d8-8828-870814b35641 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.808476 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb3ca-00c8-46d8-8828-870814b35641 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.809004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bb3ca-00c8-46d8-8828-870814b35641 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.810235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bb3ca-00c8-46d8-8828-870814b35641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.812423 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bb3ca-00c8-46d8-8828-870814b35641 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.820726 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 456/911] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Oct 3 14:39:50 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 14:39:50.904064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29367d24-d213-4d16-b0c5-92e95357d847 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:50.917087 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:50.947996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba84159-126a-4378-8402-2745fdae5125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:50.949052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba84159-126a-4378-8402-2745fdae5125 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:50.950122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba84159-126a-4378-8402-2745fdae5125 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:50.950706 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba84159-126a-4378-8402-2745fdae5125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:50.951744 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba84159-126a-4378-8402-2745fdae5125 None admin] RBAC: Adding query filter params (role.id=3078f35bd776448fae317ac755cbac23, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=48ba8f16b64e4625866d7052846d906a) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:50.952275 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba84159-126a-4378-8402-2745fdae5125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:50.953971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba84159-126a-4378-8402-2745fdae5125 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:50.961483 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 456/912] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:39:50 2022] GET /identity/v3/role_assignments?user.id=48ba8f16b64e4625866d7052846d906a&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=3078f35bd776448fae317ac755cbac23 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:51.054078 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823dcff-3343-454b-a6c3-fe54f0b7f99a None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:51.054593 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823dcff-3343-454b-a6c3-fe54f0b7f99a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:51.054682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823dcff-3343-454b-a6c3-fe54f0b7f99a None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:51.056285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 457/913] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:51.062172 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc13d1-82ad-45d5-a6ea-e196a43c43ee None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:51.062710 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc13d1-82ad-45d5-a6ea-e196a43c43ee None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:51.062710 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc13d1-82ad-45d5-a6ea-e196a43c43ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:51.082224 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-e8bc13d1-82ad-45d5-a6ea-e196a43c43ee None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:51.083463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-e8bc13d1-82ad-45d5-a6ea-e196a43c43ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:51.167029 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 457/914] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:51.432604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823dcff-3343-454b-a6c3-fe54f0b7f99a None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:51.521186 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:51.541447 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823dcff-3343-454b-a6c3-fe54f0b7f99a None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:51.577734 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb409862-3bb4-469a-a087-52c77adf258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:51.578766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb409862-3bb4-469a-a087-52c77adf258d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:51.579403 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb409862-3bb4-469a-a087-52c77adf258d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:51.579875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb409862-3bb4-469a-a087-52c77adf258d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:51.580680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb409862-3bb4-469a-a087-52c77adf258d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:51.582221 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb409862-3bb4-469a-a087-52c77adf258d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-bb409862-3bb4-469a-a087-52c77adf258d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:51.592346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:51.593376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:51.594219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:51.596967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 458/915] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:51.604532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc13d1-82ad-45d5-a6ea-e196a43c43ee None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:51.704909 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc13d1-82ad-45d5-a6ea-e196a43c43ee None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:51.707242 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:51.739700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226f76-fbd3-4d65-87f3-33d43cbcb360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:51.740305 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226f76-fbd3-4d65-87f3-33d43cbcb360 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:51.740644 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226f76-fbd3-4d65-87f3-33d43cbcb360 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:51.740917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a226f76-fbd3-4d65-87f3-33d43cbcb360 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:51.741533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226f76-fbd3-4d65-87f3-33d43cbcb360 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:51.741833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226f76-fbd3-4d65-87f3-33d43cbcb360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:51.743198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a226f76-fbd3-4d65-87f3-33d43cbcb360 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:51.748580 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 458/916] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:39:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:51.754325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb409862-3bb4-469a-a087-52c77adf258d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:51.857701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb409862-3bb4-469a-a087-52c77adf258d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:51.890889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba0f50-f75e-44e2-8b10-8130ca7179a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:51.891525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba0f50-f75e-44e2-8b10-8130ca7179a6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:51.891803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba0f50-f75e-44e2-8b10-8130ca7179a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:51.892075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba0f50-f75e-44e2-8b10-8130ca7179a6 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:51.892697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba0f50-f75e-44e2-8b10-8130ca7179a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:51.892998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba0f50-f75e-44e2-8b10-8130ca7179a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:51.894410 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba0f50-f75e-44e2-8b10-8130ca7179a6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:51.899815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 459/917] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:39:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:51.906385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226f76-fbd3-4d65-87f3-33d43cbcb360 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:52.016817 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a226f76-fbd3-4d65-87f3-33d43cbcb360 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:52.050808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911ca0f-4ed5-4218-95ea-167d1cc03f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:52.051451 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911ca0f-4ed5-4218-95ea-167d1cc03f8e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:52.051731 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911ca0f-4ed5-4218-95ea-167d1cc03f8e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:52.052052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911ca0f-4ed5-4218-95ea-167d1cc03f8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:52.052746 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911ca0f-4ed5-4218-95ea-167d1cc03f8e None admin] RBAC: Adding query filter params (interface=public, service_id=7e113c094275443ca1060359b363ba2e, region_id=RegionOne) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:52.053052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911ca0f-4ed5-4218-95ea-167d1cc03f8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:52.054394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911ca0f-4ed5-4218-95ea-167d1cc03f8e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:52.062752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 459/918] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Oct 3 14:39:51 2022] GET /identity/v3/endpoints?service_id=7e113c094275443ca1060359b363ba2e&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:52.068556 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba0f50-f75e-44e2-8b10-8130ca7179a6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:52.081428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:52.086460 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6af0c6-6028-4429-aae9-bfc29971566b None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:52.086460 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6af0c6-6028-4429-aae9-bfc29971566b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:52.088362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6af0c6-6028-4429-aae9-bfc29971566b None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:52.088362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 460/919] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:52.094120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e151-f017-433e-8acd-a6c4b7138260 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:52.094412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e151-f017-433e-8acd-a6c4b7138260 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:52.094675 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e151-f017-433e-8acd-a6c4b7138260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:52.112814 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-8733e151-f017-433e-8acd-a6c4b7138260 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:52.113983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-8733e151-f017-433e-8acd-a6c4b7138260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:52.159352 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:52.182868 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 461/920] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:52.184283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba0f50-f75e-44e2-8b10-8130ca7179a6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:52.218581 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ca010-0968-4626-a718-a57a57fc19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:52.219295 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ca010-0968-4626-a718-a57a57fc19a4 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:52.219643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ca010-0968-4626-a718-a57a57fc19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:52.220001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ca010-0968-4626-a718-a57a57fc19a4 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:52.220665 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ca010-0968-4626-a718-a57a57fc19a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:52.222085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ca010-0968-4626-a718-a57a57fc19a4 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:52.228412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 460/921] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Oct 3 14:39:52 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 14:39:52.455571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733e151-f017-433e-8acd-a6c4b7138260 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:52.559357 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733e151-f017-433e-8acd-a6c4b7138260 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:52.599413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f207960-4c66-45fb-bd1a-ae2c716f27a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:52.600370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207960-4c66-45fb-bd1a-ae2c716f27a8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:52.600839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207960-4c66-45fb-bd1a-ae2c716f27a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:52.601282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f207960-4c66-45fb-bd1a-ae2c716f27a8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:52.602034 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f207960-4c66-45fb-bd1a-ae2c716f27a8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:52.603581 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f207960-4c66-45fb-bd1a-ae2c716f27a8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-1f207960-4c66-45fb-bd1a-ae2c716f27a8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:52.612911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:52.613975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 14:39:52.614834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:52.617099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 462/922] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:39:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:52.623869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ca010-0968-4626-a718-a57a57fc19a4 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:52.702630 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:52.733882 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ca010-0968-4626-a718-a57a57fc19a4 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:52.770126 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5b824-9874-4a2f-85e4-bd3b97baf05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:52.770745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5b824-9874-4a2f-85e4-bd3b97baf05f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:52.771054 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5b824-9874-4a2f-85e4-bd3b97baf05f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:52.771332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5b824-9874-4a2f-85e4-bd3b97baf05f None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:52.771958 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5b824-9874-4a2f-85e4-bd3b97baf05f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:52.772258 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5b824-9874-4a2f-85e4-bd3b97baf05f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:52.773611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5b824-9874-4a2f-85e4-bd3b97baf05f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:52.778979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 461/923] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:39:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:52.784576 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f207960-4c66-45fb-bd1a-ae2c716f27a8 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:52.832111 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:52.903538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f207960-4c66-45fb-bd1a-ae2c716f27a8 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:52.939551 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55759c0a-29e8-4338-b87f-8c8bebe76dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:52.940227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759c0a-29e8-4338-b87f-8c8bebe76dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:52.940510 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759c0a-29e8-4338-b87f-8c8bebe76dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:52.940788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55759c0a-29e8-4338-b87f-8c8bebe76dd2 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:52.941476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759c0a-29e8-4338-b87f-8c8bebe76dd2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:52.941786 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759c0a-29e8-4338-b87f-8c8bebe76dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:52.943165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55759c0a-29e8-4338-b87f-8c8bebe76dd2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:52.948783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 463/924] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Oct 3 14:39:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:52.955198 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5b824-9874-4a2f-85e4-bd3b97baf05f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:53.064908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5b824-9874-4a2f-85e4-bd3b97baf05f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:53.100263 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a9803-9cf6-4106-815f-2784baabf22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:53.100957 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9803-9cf6-4106-815f-2784baabf22e None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:53.101198 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9803-9cf6-4106-815f-2784baabf22e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:53.101474 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9803-9cf6-4106-815f-2784baabf22e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:53.102157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a9803-9cf6-4106-815f-2784baabf22e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:53.103540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a9803-9cf6-4106-815f-2784baabf22e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:53.111181 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a6fa-fdf8-441c-b6b4-e023223576bb None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:53.111629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a6fa-fdf8-441c-b6b4-e023223576bb None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:53.111732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8a6fa-fdf8-441c-b6b4-e023223576bb None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:53.115263 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:53.116883 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 464/925] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:53.118400 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d3f0-f187-45c4-a425-9cf2f28d1a32 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:53.118783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d3f0-f187-45c4-a425-9cf2f28d1a32 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:53.119098 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d3f0-f187-45c4-a425-9cf2f28d1a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:53.132235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 462/926] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:39:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:53.141060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-8180d3f0-f187-45c4-a425-9cf2f28d1a32 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:53.142286 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-8180d3f0-f187-45c4-a425-9cf2f28d1a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:53.235127 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 465/927] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:53.364443 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7e1f-ba51-4374-8833-ad47d0bd4588 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:53.365136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7e1f-ba51-4374-8833-ad47d0bd4588 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:53.365621 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a7e1f-ba51-4374-8833-ad47d0bd4588 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:53.367380 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 463/928] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:53.373705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d09ba8-176a-4bbe-a4cd-8e647fec87ce None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:53.374284 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d09ba8-176a-4bbe-a4cd-8e647fec87ce None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:53.374775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d09ba8-176a-4bbe-a4cd-8e647fec87ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:53.393760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-64d09ba8-176a-4bbe-a4cd-8e647fec87ce None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:53.395268 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-64d09ba8-176a-4bbe-a4cd-8e647fec87ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:53.407530 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:53.465981 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 466/929] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:53.511188 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a7e1f-ba51-4374-8833-ad47d0bd4588 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:53.617645 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a7e1f-ba51-4374-8833-ad47d0bd4588 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:53.653579 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c6798-7e7d-456f-858c-29136d5b180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:53.654544 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c6798-7e7d-456f-858c-29136d5b180b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:53.655115 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c6798-7e7d-456f-858c-29136d5b180b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:53.655604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c6798-7e7d-456f-858c-29136d5b180b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:53.656376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c6798-7e7d-456f-858c-29136d5b180b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:53.657947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c6798-7e7d-456f-858c-29136d5b180b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-ee3c6798-7e7d-456f-858c-29136d5b180b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:53.667195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:53.668228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 14:39:53.669113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:53.671878 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 464/930] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Oct 3 14:39:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:53.680232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d09ba8-176a-4bbe-a4cd-8e647fec87ce None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:53.750280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c6798-7e7d-456f-858c-29136d5b180b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:53.784434 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d09ba8-176a-4bbe-a4cd-8e647fec87ce None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:53.817382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:53.828353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b5146-df67-4030-b47a-46578de0b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:53.830012 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b5146-df67-4030-b47a-46578de0b016 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:53.830365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b5146-df67-4030-b47a-46578de0b016 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:53.830708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b5146-df67-4030-b47a-46578de0b016 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:53.831432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b5146-df67-4030-b47a-46578de0b016 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:53.831802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b5146-df67-4030-b47a-46578de0b016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:53.833217 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b5146-df67-4030-b47a-46578de0b016 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:53.839532 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 467/931] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:53.845239 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b5146-df67-4030-b47a-46578de0b016 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:53.865079 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:53.868629 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c6798-7e7d-456f-858c-29136d5b180b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:53.906186 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8356c9-cf39-437d-9eeb-16edae40a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:53.906749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8356c9-cf39-437d-9eeb-16edae40a081 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:53.907183 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8356c9-cf39-437d-9eeb-16edae40a081 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:53.907559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8356c9-cf39-437d-9eeb-16edae40a081 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:53.922243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8356c9-cf39-437d-9eeb-16edae40a081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-1c8356c9-cf39-437d-9eeb-16edae40a081 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:53.930470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:53.931623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:39:53.932655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:53.935418 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 465/932] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Oct 3 14:39:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:53.945224 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8356c9-cf39-437d-9eeb-16edae40a081 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:53.986776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b5146-df67-4030-b47a-46578de0b016 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:54.029324 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d368db-c5f5-4fa2-a16b-1851e4667bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:54.030536 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d368db-c5f5-4fa2-a16b-1851e4667bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:54.031056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d368db-c5f5-4fa2-a16b-1851e4667bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:54.032145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d368db-c5f5-4fa2-a16b-1851e4667bd5 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:54.033243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d368db-c5f5-4fa2-a16b-1851e4667bd5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:54.033757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d368db-c5f5-4fa2-a16b-1851e4667bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:54.035623 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d368db-c5f5-4fa2-a16b-1851e4667bd5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:54.041286 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 468/933] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:54.048962 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d368db-c5f5-4fa2-a16b-1851e4667bd5 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:54.075391 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8356c9-cf39-437d-9eeb-16edae40a081 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:54.100236 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:54.129364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ebd4-aad3-4e8c-bfab-ccfd768d779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:54.131064 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ebd4-aad3-4e8c-bfab-ccfd768d779d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:54.132117 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ebd4-aad3-4e8c-bfab-ccfd768d779d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:54.132587 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ebd4-aad3-4e8c-bfab-ccfd768d779d None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:54.133737 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ebd4-aad3-4e8c-bfab-ccfd768d779d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:54.134232 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ebd4-aad3-4e8c-bfab-ccfd768d779d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:54.137553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ebd4-aad3-4e8c-bfab-ccfd768d779d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:54.142269 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:54.155918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 466/934] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Oct 3 14:39:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:54.157418 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ebd4-aad3-4e8c-bfab-ccfd768d779d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:54.177171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d368db-c5f5-4fa2-a16b-1851e4667bd5 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:54.213643 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042efad-311e-4a35-8ee9-caa21771d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:54.214512 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042efad-311e-4a35-8ee9-caa21771d0ee None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:54.215586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042efad-311e-4a35-8ee9-caa21771d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:54.216011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042efad-311e-4a35-8ee9-caa21771d0ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:54.217233 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042efad-311e-4a35-8ee9-caa21771d0ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:54.219869 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042efad-311e-4a35-8ee9-caa21771d0ee None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:54.250756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 469/935] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:39:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:54.289092 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ebd4-aad3-4e8c-bfab-ccfd768d779d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:54.336124 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257daa0f-13c4-4eeb-b8eb-12033eff44c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:54.337161 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257daa0f-13c4-4eeb-b8eb-12033eff44c0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:54.337753 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257daa0f-13c4-4eeb-b8eb-12033eff44c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:54.338283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257daa0f-13c4-4eeb-b8eb-12033eff44c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:54.352952 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257daa0f-13c4-4eeb-b8eb-12033eff44c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:54.355130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257daa0f-13c4-4eeb-b8eb-12033eff44c0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-257daa0f-13c4-4eeb-b8eb-12033eff44c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:54.374218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:54.375296 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:54.376237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:54.376237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:54.376237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:54.378781 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 467/936] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:54.385140 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042efad-311e-4a35-8ee9-caa21771d0ee None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:54.473678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126462e-61be-436a-8f07-5898383ef19a None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:54.474105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126462e-61be-436a-8f07-5898383ef19a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:54.474462 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126462e-61be-436a-8f07-5898383ef19a None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:54.476088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 468/937] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:54.481389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aee16-832a-49ca-85ef-35b93200d40a None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:54.481673 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aee16-832a-49ca-85ef-35b93200d40a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:54.481948 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aee16-832a-49ca-85ef-35b93200d40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:54.504733 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042efad-311e-4a35-8ee9-caa21771d0ee None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:54.506192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-da1aee16-832a-49ca-85ef-35b93200d40a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:54.507393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-da1aee16-832a-49ca-85ef-35b93200d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:54.535560 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:54.537387 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:54.547520 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00c4d3-82fd-4fd8-9ae4-ceac19c3ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:54.548212 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00c4d3-82fd-4fd8-9ae4-ceac19c3ef16 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:54.548624 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00c4d3-82fd-4fd8-9ae4-ceac19c3ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:54.548898 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00c4d3-82fd-4fd8-9ae4-ceac19c3ef16 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:54.549606 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00c4d3-82fd-4fd8-9ae4-ceac19c3ef16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:54.549980 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00c4d3-82fd-4fd8-9ae4-ceac19c3ef16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:54.551466 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00c4d3-82fd-4fd8-9ae4-ceac19c3ef16 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:54.566440 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 470/938] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:54.572695 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00c4d3-82fd-4fd8-9ae4-ceac19c3ef16 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:54.589864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 469/939] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:54.678080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00c4d3-82fd-4fd8-9ae4-ceac19c3ef16 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:54.712907 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97c5ac-40bb-463d-afa7-0403cf3cc99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:54.713533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c5ac-40bb-463d-afa7-0403cf3cc99e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:54.713813 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c5ac-40bb-463d-afa7-0403cf3cc99e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:54.714089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c5ac-40bb-463d-afa7-0403cf3cc99e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:54.721353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97c5ac-40bb-463d-afa7-0403cf3cc99e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:54.722764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97c5ac-40bb-463d-afa7-0403cf3cc99e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-6f97c5ac-40bb-463d-afa7-0403cf3cc99e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:54.734852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:54.735808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:54.736769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:54.740647 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 471/940] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:39:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:54.742043 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aee16-832a-49ca-85ef-35b93200d40a None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:54.845662 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aee16-832a-49ca-85ef-35b93200d40a None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:54.868145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97c5ac-40bb-463d-afa7-0403cf3cc99e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:54.888198 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f257a7-107e-4203-8ba8-60afd6ed4cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:54.889105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f257a7-107e-4203-8ba8-60afd6ed4cbf None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:54.889396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f257a7-107e-4203-8ba8-60afd6ed4cbf None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:54.889670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f257a7-107e-4203-8ba8-60afd6ed4cbf None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:54.890395 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f257a7-107e-4203-8ba8-60afd6ed4cbf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:54.890699 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f257a7-107e-4203-8ba8-60afd6ed4cbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:54.892148 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f257a7-107e-4203-8ba8-60afd6ed4cbf None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:54.919037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 470/941] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Oct 3 14:39:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:54.922307 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f257a7-107e-4203-8ba8-60afd6ed4cbf None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:54.928512 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:54.959370 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:54.994047 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97c5ac-40bb-463d-afa7-0403cf3cc99e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:55.035240 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f257a7-107e-4203-8ba8-60afd6ed4cbf None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:55.041912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ee10a-ac18-4b2a-a6aa-4113234513cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:55.042696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ee10a-ac18-4b2a-a6aa-4113234513cd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.043632 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ee10a-ac18-4b2a-a6aa-4113234513cd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.044010 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ee10a-ac18-4b2a-a6aa-4113234513cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.044664 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ee10a-ac18-4b2a-a6aa-4113234513cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:55.046755 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ee10a-ac18-4b2a-a6aa-4113234513cd None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-562ee10a-ac18-4b2a-a6aa-4113234513cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:55.059815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:55.060846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:55.061688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 472/942] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:55.069091 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ee10a-ac18-4b2a-a6aa-4113234513cd None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:55.080639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4910-cbb7-4155-b536-c170bcbb511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:55.081277 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4910-cbb7-4155-b536-c170bcbb511a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.081557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4910-cbb7-4155-b536-c170bcbb511a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.081829 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4910-cbb7-4155-b536-c170bcbb511a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.097401 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd4910-cbb7-4155-b536-c170bcbb511a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:55.099346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd4910-cbb7-4155-b536-c170bcbb511a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-f9bd4910-cbb7-4155-b536-c170bcbb511a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:55.117617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:55.118616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:55.119553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:55.119553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:55.119553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:55.123768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 471/943] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:55.124775 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4910-cbb7-4155-b536-c170bcbb511a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:55.196716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:55.205274 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ee10a-ac18-4b2a-a6aa-4113234513cd None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:55.225212 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:55.237992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4910-cbb7-4155-b536-c170bcbb511a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:55.253882 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da651-e41a-45c0-9533-4407ae437af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:55.255136 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da651-e41a-45c0-9533-4407ae437af7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.255618 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da651-e41a-45c0-9533-4407ae437af7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.256309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da651-e41a-45c0-9533-4407ae437af7 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.257603 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da651-e41a-45c0-9533-4407ae437af7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:55.258100 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da651-e41a-45c0-9533-4407ae437af7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:55.259889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da651-e41a-45c0-9533-4407ae437af7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:55.269471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 473/944] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:39:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:55.275973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da651-e41a-45c0-9533-4407ae437af7 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:55.284859 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedfb2f-f40e-41f8-9653-94aee6f5e733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:55.285467 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedfb2f-f40e-41f8-9653-94aee6f5e733 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.285742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedfb2f-f40e-41f8-9653-94aee6f5e733 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.286012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dedfb2f-f40e-41f8-9653-94aee6f5e733 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.286648 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedfb2f-f40e-41f8-9653-94aee6f5e733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:55.286961 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedfb2f-f40e-41f8-9653-94aee6f5e733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:55.288325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dedfb2f-f40e-41f8-9653-94aee6f5e733 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:55.307075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 472/945] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:55.308104 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedfb2f-f40e-41f8-9653-94aee6f5e733 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:55.410346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da651-e41a-45c0-9533-4407ae437af7 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:55.440380 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dedfb2f-f40e-41f8-9653-94aee6f5e733 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:55.446494 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d0f63-6c3f-402b-ba28-c932911512ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:55.447240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0f63-6c3f-402b-ba28-c932911512ca None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.447466 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0f63-6c3f-402b-ba28-c932911512ca None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.447836 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0f63-6c3f-402b-ba28-c932911512ca None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.448465 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d0f63-6c3f-402b-ba28-c932911512ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:55.448763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d0f63-6c3f-402b-ba28-c932911512ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:55.450924 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d0f63-6c3f-402b-ba28-c932911512ca None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:55.461009 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 474/946] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:39:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:55.461816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d0f63-6c3f-402b-ba28-c932911512ca None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:55.477204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:55.488458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9ceea-374d-4b2c-a457-a2eb825c4a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:55.489518 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9ceea-374d-4b2c-a457-a2eb825c4a23 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.490022 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9ceea-374d-4b2c-a457-a2eb825c4a23 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.490796 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9ceea-374d-4b2c-a457-a2eb825c4a23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.501604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9ceea-374d-4b2c-a457-a2eb825c4a23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:55.503355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9ceea-374d-4b2c-a457-a2eb825c4a23 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:55.508890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-92e9ceea-374d-4b2c-a457-a2eb825c4a23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:55.518884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:55.519814 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:55.520714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:55.520714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:55.520714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:55.520714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:55.520714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:55.520714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:55.520714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:55.520714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:55.526782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 473/947] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:55.526782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc7b34-8f63-42d2-9fc8-fa9f88dfc48d None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.526782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc7b34-8f63-42d2-9fc8-fa9f88dfc48d None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.526782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc7b34-8f63-42d2-9fc8-fa9f88dfc48d None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.526782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 474/948] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:55.529704 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc7b34-8f63-42d2-9fc8-fa9f88dfc48d None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:55.575208 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d0f63-6c3f-402b-ba28-c932911512ca None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:55.612437 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176c3fa-6657-4ab7-bcc1-3a4dbc7d959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:55.613093 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176c3fa-6657-4ab7-bcc1-3a4dbc7d959a None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.613379 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176c3fa-6657-4ab7-bcc1-3a4dbc7d959a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.613653 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176c3fa-6657-4ab7-bcc1-3a4dbc7d959a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.614377 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176c3fa-6657-4ab7-bcc1-3a4dbc7d959a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:55.615764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176c3fa-6657-4ab7-bcc1-3a4dbc7d959a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:55.647301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 475/949] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:39:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:39:55.647301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e2c72-3c5c-4450-9b80-4345ae5b15b8 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.647301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e2c72-3c5c-4450-9b80-4345ae5b15b8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.647301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e2c72-3c5c-4450-9b80-4345ae5b15b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.662978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc7b34-8f63-42d2-9fc8-fa9f88dfc48d None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:55.663963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-fe0e2c72-3c5c-4450-9b80-4345ae5b15b8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:55.665700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-fe0e2c72-3c5c-4450-9b80-4345ae5b15b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:55.718181 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d19421-5c82-4c8d-b00a-6f15a7d43bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:55.718834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d19421-5c82-4c8d-b00a-6f15a7d43bc1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.719337 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d19421-5c82-4c8d-b00a-6f15a7d43bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.719719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d19421-5c82-4c8d-b00a-6f15a7d43bc1 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.720582 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d19421-5c82-4c8d-b00a-6f15a7d43bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:55.721002 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d19421-5c82-4c8d-b00a-6f15a7d43bc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:55.722759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d19421-5c82-4c8d-b00a-6f15a7d43bc1 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:55.742863 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 475/950] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:55.744436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d19421-5c82-4c8d-b00a-6f15a7d43bc1 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:55.775120 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 476/951] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:55.826377 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:55.887089 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d19421-5c82-4c8d-b00a-6f15a7d43bc1 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:55.924196 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a977c7-acb5-407a-bead-5a11dc76066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:55.924859 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a977c7-acb5-407a-bead-5a11dc76066f None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:55.925139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a977c7-acb5-407a-bead-5a11dc76066f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:55.925410 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a977c7-acb5-407a-bead-5a11dc76066f None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/48ba8f16b64e4625866d7052846d906a/roles/3078f35bd776448fae317ac755cbac23` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:55.927569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a977c7-acb5-407a-bead-5a11dc76066f None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=48ba8f16b64e4625866d7052846d906a, role_id=3078f35bd776448fae317ac755cbac23)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:55.928984 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a977c7-acb5-407a-bead-5a11dc76066f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:55.947136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 476/952] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:39:55 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/48ba8f16b64e4625866d7052846d906a/roles/3078f35bd776448fae317ac755cbac23 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 14:39:56.063026 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e2c72-3c5c-4450-9b80-4345ae5b15b8 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:56.097059 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:56.176925 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e2c72-3c5c-4450-9b80-4345ae5b15b8 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:56.213773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:56.214385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:56.214656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:56.215027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:56.216066 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:56.217480 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:56.220196 dv-cinder-859877-2-smb devstack@keystone.service[87857]: WARNING keystone.server.flask.common [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 03 14:39:56.240360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.sql.core [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 14:39:56.240360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 03 14:39:56.240360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [parameters: {'id': '95e98b408af548da8843b2807ca87dab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 03 14:39:56.240360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87857) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95e98b408af548da8843b2807ca87dab.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95e98b408af548da8843b2807ca87dab. Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application conn.query(q) Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:39:56.249011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application result.read() Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 03 14:39:56.249798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application next(self.gen) Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application yield resource Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application next(self.gen) Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise self.value Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application session.commit() Oct 03 14:39:56.250763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.session.flush() Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application compat.raise_( Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 14:39:56.251684 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 14:39:56.252617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application conn.query(q) Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application result.read() Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:39:56.253424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [parameters: {'id': '95e98b408af548da8843b2807ca87dab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:56.254279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:56.256420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 95e98b408af548da8843b2807ca87dab. Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:56.257607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 477/953] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Oct 3 14:39:56 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:56.259447 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a977c7-acb5-407a-bead-5a11dc76066f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:56.383359 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a977c7-acb5-407a-bead-5a11dc76066f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:56.385715 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:56.420386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d244c-2394-4ae3-87a5-2ecfa60c5d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:56.421032 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d244c-2394-4ae3-87a5-2ecfa60c5d41 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:56.421315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d244c-2394-4ae3-87a5-2ecfa60c5d41 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:56.421595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d244c-2394-4ae3-87a5-2ecfa60c5d41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:56.428906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d244c-2394-4ae3-87a5-2ecfa60c5d41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:56.430655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d244c-2394-4ae3-87a5-2ecfa60c5d41 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e99d244c-2394-4ae3-87a5-2ecfa60c5d41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:39:56.442917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:56.443920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:56.444857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:39:56.444857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:39:56.444857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:39:56.444857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:39:56.444857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:39:56.444857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:39:56.444857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:39:56.444857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:56.444857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 477/954] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:56.452282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:56.551633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:56.570595 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d599bf-ef31-4a7b-8fe9-ab68815b0e5b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:56.607263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6ee49-0dc7-473d-b38e-b1e9fe3d9bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:56.608267 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ee49-0dc7-473d-b38e-b1e9fe3d9bf1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:56.608756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ee49-0dc7-473d-b38e-b1e9fe3d9bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:56.609243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6ee49-0dc7-473d-b38e-b1e9fe3d9bf1 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:56.610229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ee49-0dc7-473d-b38e-b1e9fe3d9bf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:56.610746 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ee49-0dc7-473d-b38e-b1e9fe3d9bf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:56.611690 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77718-4df6-496a-a4fb-cb36973c8495 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:56.611976 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77718-4df6-496a-a4fb-cb36973c8495 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:56.612307 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77718-4df6-496a-a4fb-cb36973c8495 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:56.612438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6ee49-0dc7-473d-b38e-b1e9fe3d9bf1 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:56.613973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 478/955] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:39:56.619861 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fdce8-2363-4ee7-bffc-4692d1df0804 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:56.620742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fdce8-2363-4ee7-bffc-4692d1df0804 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:56.621743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fdce8-2363-4ee7-bffc-4692d1df0804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:56.639075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 478/956] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:39:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:56.644071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-c08fdce8-2363-4ee7-bffc-4692d1df0804 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:56.645592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-c08fdce8-2363-4ee7-bffc-4692d1df0804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:56.723386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 479/957] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:57.002429 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6ee49-0dc7-473d-b38e-b1e9fe3d9bf1 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:57.119529 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6ee49-0dc7-473d-b38e-b1e9fe3d9bf1 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:57.154832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ec78-fbc5-4afc-878f-0a744b0b4a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:57.155490 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ec78-fbc5-4afc-878f-0a744b0b4a69 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:57.155770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ec78-fbc5-4afc-878f-0a744b0b4a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:57.156037 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0ec78-fbc5-4afc-878f-0a744b0b4a69 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:57.156612 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0ec78-fbc5-4afc-878f-0a744b0b4a69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:57.157957 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0ec78-fbc5-4afc-878f-0a744b0b4a69 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-59e0ec78-fbc5-4afc-878f-0a744b0b4a69 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:57.166816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:57.167930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:57.168921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 479/958] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:39:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:57.176272 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fdce8-2363-4ee7-bffc-4692d1df0804 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:57.280870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:57.288658 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fdce8-2363-4ee7-bffc-4692d1df0804 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:57.326150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec9413-8344-4aef-8069-9aa49c2c5677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:57.327166 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec9413-8344-4aef-8069-9aa49c2c5677 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:57.327660 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec9413-8344-4aef-8069-9aa49c2c5677 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:57.328139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec9413-8344-4aef-8069-9aa49c2c5677 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:57.328965 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec9413-8344-4aef-8069-9aa49c2c5677 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:57.329494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec9413-8344-4aef-8069-9aa49c2c5677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:57.331079 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec9413-8344-4aef-8069-9aa49c2c5677 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:57.336390 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 480/959] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:39:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:57.342871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ec78-fbc5-4afc-878f-0a744b0b4a69 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:57.358174 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:57.456546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0ec78-fbc5-4afc-878f-0a744b0b4a69 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:57.492273 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840fb48-b897-4316-a871-d860c96fe610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:57.492880 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840fb48-b897-4316-a871-d860c96fe610 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:57.493155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840fb48-b897-4316-a871-d860c96fe610 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:57.493427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840fb48-b897-4316-a871-d860c96fe610 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:57.494046 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840fb48-b897-4316-a871-d860c96fe610 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:57.494340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840fb48-b897-4316-a871-d860c96fe610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:57.496163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840fb48-b897-4316-a871-d860c96fe610 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:57.501724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 480/960] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:39:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:57.915902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ab15-d42a-4646-b8b3-368ab916f183 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:57.916185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ab15-d42a-4646-b8b3-368ab916f183 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:57.916735 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ab15-d42a-4646-b8b3-368ab916f183 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:57.918631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 481/961] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:57.924189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073bc0e-eaf5-423d-81b4-828f01f90511 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:57.924712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073bc0e-eaf5-423d-81b4-828f01f90511 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:57.925181 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073bc0e-eaf5-423d-81b4-828f01f90511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:57.944656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-9073bc0e-eaf5-423d-81b4-828f01f90511 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:57.946465 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-9073bc0e-eaf5-423d-81b4-828f01f90511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:58.018312 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 481/962] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:58.297705 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ab15-d42a-4646-b8b3-368ab916f183 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:58.350344 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a1f13-d388-4abe-8cb1-20547acfe2fd None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:58.350863 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a1f13-d388-4abe-8cb1-20547acfe2fd None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:58.350977 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a1f13-d388-4abe-8cb1-20547acfe2fd None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:58.352422 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 482/963] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:58.358633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c016-fc5e-4ef3-b15a-430cb7f8ba1b None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:58.358929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c016-fc5e-4ef3-b15a-430cb7f8ba1b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:58.359230 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c016-fc5e-4ef3-b15a-430cb7f8ba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:58.367681 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:58.385917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-49e0c016-fc5e-4ef3-b15a-430cb7f8ba1b None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:58.387998 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-49e0c016-fc5e-4ef3-b15a-430cb7f8ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:58.410240 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ab15-d42a-4646-b8b3-368ab916f183 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:58.460187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c586e-3b6e-4888-a574-c44af87682bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:58.461189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c586e-3b6e-4888-a574-c44af87682bf None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:58.461614 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c586e-3b6e-4888-a574-c44af87682bf None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:58.462126 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c586e-3b6e-4888-a574-c44af87682bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:58.462908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c586e-3b6e-4888-a574-c44af87682bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:58.470968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c586e-3b6e-4888-a574-c44af87682bf None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:58.471105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 483/964] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e38c586e-3b6e-4888-a574-c44af87682bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:58.479810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:58.481444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:58.482653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 482/965] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:39:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:58.487714 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0c016-fc5e-4ef3-b15a-430cb7f8ba1b None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:58.600427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0c016-fc5e-4ef3-b15a-430cb7f8ba1b None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:58.631326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:58.637301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fd2ce-58b7-42d1-906a-45dbdcf76ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:58.638110 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fd2ce-58b7-42d1-906a-45dbdcf76ca5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:58.638776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fd2ce-58b7-42d1-906a-45dbdcf76ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:58.639439 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fd2ce-58b7-42d1-906a-45dbdcf76ca5 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:58.640118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fd2ce-58b7-42d1-906a-45dbdcf76ca5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:58.640801 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fd2ce-58b7-42d1-906a-45dbdcf76ca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:58.642216 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fd2ce-58b7-42d1-906a-45dbdcf76ca5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:58.647341 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 484/966] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:39:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:39:58.652916 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c586e-3b6e-4888-a574-c44af87682bf None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:58.678457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:58.760328 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c586e-3b6e-4888-a574-c44af87682bf None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:58.785257 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fd2ce-58b7-42d1-906a-45dbdcf76ca5 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:58.795862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb932ff9-bc77-490d-ac5e-4fc80bb974c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:58.796476 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb932ff9-bc77-490d-ac5e-4fc80bb974c3 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:58.796757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb932ff9-bc77-490d-ac5e-4fc80bb974c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:58.797030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb932ff9-bc77-490d-ac5e-4fc80bb974c3 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:58.797716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb932ff9-bc77-490d-ac5e-4fc80bb974c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:58.798020 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb932ff9-bc77-490d-ac5e-4fc80bb974c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:58.799438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb932ff9-bc77-490d-ac5e-4fc80bb974c3 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:58.804816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 483/967] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:39:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:58.811237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb932ff9-bc77-490d-ac5e-4fc80bb974c3 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:58.898966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fd2ce-58b7-42d1-906a-45dbdcf76ca5 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:58.915527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:58.937891 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb932ff9-bc77-490d-ac5e-4fc80bb974c3 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:58.944118 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45289681-93f5-4f06-9224-996f820b64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:58.944994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289681-93f5-4f06-9224-996f820b64c5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:58.945541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289681-93f5-4f06-9224-996f820b64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:58.946018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45289681-93f5-4f06-9224-996f820b64c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:58.957694 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45289681-93f5-4f06-9224-996f820b64c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-45289681-93f5-4f06-9224-996f820b64c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:39:58.963527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:58.964685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:39:58.966327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:58.968342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 485/968] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Oct 3 14:39:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:58.969691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e2b0c-fa15-4282-9086-04e53c708675 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:58.969971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e2b0c-fa15-4282-9086-04e53c708675 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:58.970240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e2b0c-fa15-4282-9086-04e53c708675 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:58.971713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 486/969] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:58.974395 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e2b0c-fa15-4282-9086-04e53c708675 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:58.976235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab7e7c-b93e-4826-aa89-f2fd65c83584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:58.977293 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab7e7c-b93e-4826-aa89-f2fd65c83584 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:58.977691 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab7e7c-b93e-4826-aa89-f2fd65c83584 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:58.977970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab7e7c-b93e-4826-aa89-f2fd65c83584 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:58.978672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab7e7c-b93e-4826-aa89-f2fd65c83584 None admin] RBAC: Adding query filter params (interface=admin, service_id=7e113c094275443ca1060359b363ba2e, region_id=RegionOne) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:58.979009 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab7e7c-b93e-4826-aa89-f2fd65c83584 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:58.980430 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab7e7c-b93e-4826-aa89-f2fd65c83584 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:58.985801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 484/970] 10.222.0.39 () {56 vars in 1249 bytes} [Mon Oct 3 14:39:58 2022] GET /identity/v3/endpoints?service_id=7e113c094275443ca1060359b363ba2e&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:58.986968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a4865-a9ae-414e-8e0f-bdf7c0a4d9c8 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:58.987373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a4865-a9ae-414e-8e0f-bdf7c0a4d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:58.987662 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a4865-a9ae-414e-8e0f-bdf7c0a4d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.005143 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-b60a4865-a9ae-414e-8e0f-bdf7c0a4d9c8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:59.006303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-b60a4865-a9ae-414e-8e0f-bdf7c0a4d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:59.041388 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:59.075634 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 485/971] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:59.076469 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a4865-a9ae-414e-8e0f-bdf7c0a4d9c8 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:59.098181 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e2b0c-fa15-4282-9086-04e53c708675 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:59.140211 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1607cd-2a0e-40c7-9f87-f3859dce24a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:59.140850 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1607cd-2a0e-40c7-9f87-f3859dce24a8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.141140 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1607cd-2a0e-40c7-9f87-f3859dce24a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.141397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1607cd-2a0e-40c7-9f87-f3859dce24a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.142463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1607cd-2a0e-40c7-9f87-f3859dce24a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:59.142767 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1607cd-2a0e-40c7-9f87-f3859dce24a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:59.144433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1607cd-2a0e-40c7-9f87-f3859dce24a8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:59.158988 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 487/972] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Oct 3 14:39:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:59.159924 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1607cd-2a0e-40c7-9f87-f3859dce24a8 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:59.195317 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:59.217105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a4865-a9ae-414e-8e0f-bdf7c0a4d9c8 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:59.261998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43423c-adf0-4686-9989-bfe7e264251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:59.262865 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43423c-adf0-4686-9989-bfe7e264251e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.263433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43423c-adf0-4686-9989-bfe7e264251e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.263875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43423c-adf0-4686-9989-bfe7e264251e None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.264628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43423c-adf0-4686-9989-bfe7e264251e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:59.266157 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43423c-adf0-4686-9989-bfe7e264251e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:59.279407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 486/973] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Oct 3 14:39:59 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 14:39:59.304871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1607cd-2a0e-40c7-9f87-f3859dce24a8 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:59.326024 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:59.346901 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29896cb5-643c-45a4-a05f-a80a74182857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:59.347583 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29896cb5-643c-45a4-a05f-a80a74182857 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.347864 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29896cb5-643c-45a4-a05f-a80a74182857 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.348141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29896cb5-643c-45a4-a05f-a80a74182857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.361031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43423c-adf0-4686-9989-bfe7e264251e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:59.361547 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29896cb5-643c-45a4-a05f-a80a74182857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:59.362746 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29896cb5-643c-45a4-a05f-a80a74182857 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-29896cb5-643c-45a4-a05f-a80a74182857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:39:59.384070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:59.385138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:39:59.386057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:39:59.386057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:39:59.386057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:59.386057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 488/974] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:59.393822 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29896cb5-643c-45a4-a05f-a80a74182857 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:59.499683 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43423c-adf0-4686-9989-bfe7e264251e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:59.525777 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29896cb5-643c-45a4-a05f-a80a74182857 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:59.541016 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:59.541697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.541979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.542254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.543449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:59.544878 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:59.547542 dv-cinder-859877-2-smb devstack@keystone.service[87856]: WARNING keystone.server.flask.common [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 03 14:39:59.561718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.sql.core [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 14:39:59.561718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 03 14:39:59.561718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [parameters: {'user_id': '8d923529c1dd403eb37ce27c91a7bd58', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 03 14:39:59.561718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87856) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 14:39:59.569115 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d655d14-c26a-48bb-aff6-88a2796f14e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:59.569828 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655d14-c26a-48bb-aff6-88a2796f14e8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.570133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655d14-c26a-48bb-aff6-88a2796f14e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.570793 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655d14-c26a-48bb-aff6-88a2796f14e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.571195 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d655d14-c26a-48bb-aff6-88a2796f14e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:59.571501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d655d14-c26a-48bb-aff6-88a2796f14e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:59.572994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d655d14-c26a-48bb-aff6-88a2796f14e8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application conn.query(q) Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application result.read() Oct 03 14:39:59.580870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 14:39:59.581872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application next(self.gen) Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application yield resource Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application next(self.gen) Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise self.value Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application session.commit() Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 14:39:59.582830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self.session.flush() Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application compat.raise_( Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 14:39:59.583762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 14:39:59.584675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application conn.query(q) Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application result.read() Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 14:39:59.585558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [parameters: {'user_id': '8d923529c1dd403eb37ce27c91a7bd58', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:59.586513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 03 14:39:59.591460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 03 14:39:59.592566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 03 14:39:59.592566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 03 14:39:59.592566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 14:39:59.592566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 14:39:59.592566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 03 14:39:59.592566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:59.592566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 487/975] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Oct 3 14:39:59 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:39:59.592566 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:59.593114 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 489/976] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:39:59.600199 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d655d14-c26a-48bb-aff6-88a2796f14e8 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:59.602738 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:59.641206 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:59.725456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129a47d-5784-4785-8d76-45c3d0765750 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:59.729380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d655d14-c26a-48bb-aff6-88a2796f14e8 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:59.764318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b90c6d-3eab-441f-a095-a12bb38190c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:59.764866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b90c6d-3eab-441f-a095-a12bb38190c9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.765144 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b90c6d-3eab-441f-a095-a12bb38190c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.765414 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b90c6d-3eab-441f-a095-a12bb38190c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.772133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7aa0d-033a-4def-8aae-7fb2cee8420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:59.772769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7aa0d-033a-4def-8aae-7fb2cee8420a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.772969 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b90c6d-3eab-441f-a095-a12bb38190c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:59.773076 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7aa0d-033a-4def-8aae-7fb2cee8420a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.773310 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7aa0d-033a-4def-8aae-7fb2cee8420a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.774582 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b90c6d-3eab-441f-a095-a12bb38190c9 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:59.781290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7aa0d-033a-4def-8aae-7fb2cee8420a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:59.782704 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7aa0d-033a-4def-8aae-7fb2cee8420a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-b0b90c6d-3eab-441f-a095-a12bb38190c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:59.786179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:59.787160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:39:59.788109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 488/977] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:39:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:59.789255 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd315062-37f5-4f35-bb91-9c4c37e35ce9 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.789255 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd315062-37f5-4f35-bb91-9c4c37e35ce9 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.789505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd315062-37f5-4f35-bb91-9c4c37e35ce9 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.794303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 489/978] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:39:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:39:59.796054 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd315062-37f5-4f35-bb91-9c4c37e35ce9 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-c0a7aa0d-033a-4def-8aae-7fb2cee8420a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:39:59.801997 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:39:59.803288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 14:39:59.804511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:39:59.807285 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 490/979] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:39:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:39:59.808349 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057e261-ad8d-42a8-b5a6-4ad00059c10e None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.808740 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057e261-ad8d-42a8-b5a6-4ad00059c10e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.809189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057e261-ad8d-42a8-b5a6-4ad00059c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.828115 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-4057e261-ad8d-42a8-b5a6-4ad00059c10e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:39:59.829310 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-4057e261-ad8d-42a8-b5a6-4ad00059c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:39:59.872359 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:59.914976 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 491/980] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:39:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:39:59.914976 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057e261-ad8d-42a8-b5a6-4ad00059c10e None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:39:59.921672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd315062-37f5-4f35-bb91-9c4c37e35ce9 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:39:59.937315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:39:59.958838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8714f-a562-4057-922c-1060d2515b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:39:59.959845 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8714f-a562-4057-922c-1060d2515b98 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:39:59.960301 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8714f-a562-4057-922c-1060d2515b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:39:59.960787 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8714f-a562-4057-922c-1060d2515b98 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:39:59.961778 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8714f-a562-4057-922c-1060d2515b98 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:39:59.962256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8714f-a562-4057-922c-1060d2515b98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:39:59.964082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8714f-a562-4057-922c-1060d2515b98 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:00.010985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 490/981] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Oct 3 14:39:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:00.029608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057e261-ad8d-42a8-b5a6-4ad00059c10e None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:00.073757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997c8f-9f7c-4410-92a2-c13d8b61dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:00.074796 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997c8f-9f7c-4410-92a2-c13d8b61dab3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:00.075093 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997c8f-9f7c-4410-92a2-c13d8b61dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:00.075362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997c8f-9f7c-4410-92a2-c13d8b61dab3 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:00.076168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2997c8f-9f7c-4410-92a2-c13d8b61dab3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:00.076475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2997c8f-9f7c-4410-92a2-c13d8b61dab3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:00.077954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2997c8f-9f7c-4410-92a2-c13d8b61dab3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:00.103106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 492/982] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Oct 3 14:39:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:00.104669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8714f-a562-4057-922c-1060d2515b98 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:00.215700 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8714f-a562-4057-922c-1060d2515b98 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:00.215957 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997c8f-9f7c-4410-92a2-c13d8b61dab3 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:00.251560 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:00.265331 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f326f4-1ca1-4910-8429-e08bf775fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:00.266284 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f326f4-1ca1-4910-8429-e08bf775fe93 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:00.266782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f326f4-1ca1-4910-8429-e08bf775fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:00.267274 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f326f4-1ca1-4910-8429-e08bf775fe93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:00.334393 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:00.362497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f326f4-1ca1-4910-8429-e08bf775fe93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:00.363990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f326f4-1ca1-4910-8429-e08bf775fe93 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:00.368974 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997c8f-9f7c-4410-92a2-c13d8b61dab3 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:00.412290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb18cdd-0df1-4fa1-9091-bdc031198335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:00.412895 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb18cdd-0df1-4fa1-9091-bdc031198335 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:00.413175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb18cdd-0df1-4fa1-9091-bdc031198335 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:00.413445 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb18cdd-0df1-4fa1-9091-bdc031198335 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:00.414102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb18cdd-0df1-4fa1-9091-bdc031198335 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:00.415476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb18cdd-0df1-4fa1-9091-bdc031198335 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:00.431075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 493/983] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:40:00 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 14:40:00.480230 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 491/984] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:00 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:00.483433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb18cdd-0df1-4fa1-9091-bdc031198335 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:00.603071 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb18cdd-0df1-4fa1-9091-bdc031198335 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:00.642482 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5250208-8629-48c4-9801-50c489f9332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:00.643471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5250208-8629-48c4-9801-50c489f9332e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:00.643757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5250208-8629-48c4-9801-50c489f9332e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:00.644036 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5250208-8629-48c4-9801-50c489f9332e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:00.645992 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:00.656853 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5250208-8629-48c4-9801-50c489f9332e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:00.658310 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5250208-8629-48c4-9801-50c489f9332e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-c5250208-8629-48c4-9801-50c489f9332e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:40:00.674785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:00.675826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:40:00.676741 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:40:00.676741 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:00.676741 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:00.679024 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 494/985] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:00.681791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f326f4-1ca1-4910-8429-e08bf775fe93 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:00.709236 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:00.788205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f326f4-1ca1-4910-8429-e08bf775fe93 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:00.822637 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32609c1-9255-47c8-b66d-c595d01c7a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:00.823281 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32609c1-9255-47c8-b66d-c595d01c7a64 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:00.823561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32609c1-9255-47c8-b66d-c595d01c7a64 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:00.823838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32609c1-9255-47c8-b66d-c595d01c7a64 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:00.825149 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32609c1-9255-47c8-b66d-c595d01c7a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:00.825458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32609c1-9255-47c8-b66d-c595d01c7a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:00.826819 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32609c1-9255-47c8-b66d-c595d01c7a64 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:00.843498 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 492/986] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:00.845079 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5250208-8629-48c4-9801-50c489f9332e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:00.953430 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5250208-8629-48c4-9801-50c489f9332e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:00.988189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f7628-d302-463f-8744-0dc253ba7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:00.988825 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f7628-d302-463f-8744-0dc253ba7570 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:00.989107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f7628-d302-463f-8744-0dc253ba7570 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:00.989383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f7628-d302-463f-8744-0dc253ba7570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:00.996504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f7628-d302-463f-8744-0dc253ba7570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:00.997928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f7628-d302-463f-8744-0dc253ba7570 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-3c3f7628-d302-463f-8744-0dc253ba7570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:40:01.009904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:01.010808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:01.016698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:40:01.016698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:40:01.016698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:40:01.016698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:40:01.016698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:40:01.016698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:40:01.016698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:40:01.016698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:01.016698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 495/987] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:01.018786 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32609c1-9255-47c8-b66d-c595d01c7a64 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:01.110399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:01.128222 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32609c1-9255-47c8-b66d-c595d01c7a64 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:01.162605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfeaca-1153-4fa2-95f5-fdc83daa2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:01.163261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfeaca-1153-4fa2-95f5-fdc83daa2671 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:01.163546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfeaca-1153-4fa2-95f5-fdc83daa2671 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:01.163822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfeaca-1153-4fa2-95f5-fdc83daa2671 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:01.164507 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfeaca-1153-4fa2-95f5-fdc83daa2671 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:01.164818 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfeaca-1153-4fa2-95f5-fdc83daa2671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:01.166237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfeaca-1153-4fa2-95f5-fdc83daa2671 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:01.183510 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 493/988] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:01.185338 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f7628-d302-463f-8744-0dc253ba7570 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:01.235582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:01.292616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f7628-d302-463f-8744-0dc253ba7570 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:01.325994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f251852-5dc5-4b61-b5d4-2d3e10566607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:01.326590 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251852-5dc5-4b61-b5d4-2d3e10566607 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:01.326869 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251852-5dc5-4b61-b5d4-2d3e10566607 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:01.327169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f251852-5dc5-4b61-b5d4-2d3e10566607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:01.327877 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f251852-5dc5-4b61-b5d4-2d3e10566607 None admin] RBAC: Adding query filter params (role.id=3078f35bd776448fae317ac755cbac23, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=48ba8f16b64e4625866d7052846d906a) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:01.328195 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f251852-5dc5-4b61-b5d4-2d3e10566607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:01.329586 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f251852-5dc5-4b61-b5d4-2d3e10566607 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:01.342991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 496/989] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:40:01 2022] GET /identity/v3/role_assignments?user.id=48ba8f16b64e4625866d7052846d906a&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=3078f35bd776448fae317ac755cbac23 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:01.581772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df398e7a-d159-4bef-b6b0-b078fcc5a466 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:01.582261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df398e7a-d159-4bef-b6b0-b078fcc5a466 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:01.582261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df398e7a-d159-4bef-b6b0-b078fcc5a466 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:01.583735 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 494/990] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:01.588764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be87799-14b3-453d-af75-fb9034209448 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:01.589149 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be87799-14b3-453d-af75-fb9034209448 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:01.589310 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be87799-14b3-453d-af75-fb9034209448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:01.609208 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-2be87799-14b3-453d-af75-fb9034209448 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:01.610379 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-2be87799-14b3-453d-af75-fb9034209448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:01.682127 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 497/991] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:01.959527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df398e7a-d159-4bef-b6b0-b078fcc5a466 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:02.071358 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df398e7a-d159-4bef-b6b0-b078fcc5a466 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:02.112346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71490dd-22f4-4117-adfa-61bde1a4cc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:02.112978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71490dd-22f4-4117-adfa-61bde1a4cc16 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:02.113256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71490dd-22f4-4117-adfa-61bde1a4cc16 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:02.113527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71490dd-22f4-4117-adfa-61bde1a4cc16 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:02.114103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71490dd-22f4-4117-adfa-61bde1a4cc16 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:02.115484 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71490dd-22f4-4117-adfa-61bde1a4cc16 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-b71490dd-22f4-4117-adfa-61bde1a4cc16 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:02.125327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:02.126346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:02.127228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 495/992] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Oct 3 14:40:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:02.134037 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be87799-14b3-453d-af75-fb9034209448 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:02.176446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:02.236121 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be87799-14b3-453d-af75-fb9034209448 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:02.272458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09833c-f3cc-4162-bdb4-994a15740ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:02.273077 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09833c-f3cc-4162-bdb4-994a15740ddc None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:02.273358 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09833c-f3cc-4162-bdb4-994a15740ddc None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:02.273688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09833c-f3cc-4162-bdb4-994a15740ddc None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:02.274379 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09833c-f3cc-4162-bdb4-994a15740ddc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:02.274736 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09833c-f3cc-4162-bdb4-994a15740ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:02.276126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09833c-f3cc-4162-bdb4-994a15740ddc None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:02.285700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 498/993] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:40:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:02.287370 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71490dd-22f4-4117-adfa-61bde1a4cc16 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:02.300571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:02.397645 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71490dd-22f4-4117-adfa-61bde1a4cc16 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:02.433287 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1374278-b1b1-4e3d-9c76-8e0ca333d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:02.434304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374278-b1b1-4e3d-9c76-8e0ca333d333 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:02.434770 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374278-b1b1-4e3d-9c76-8e0ca333d333 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:02.435272 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1374278-b1b1-4e3d-9c76-8e0ca333d333 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:02.436131 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1374278-b1b1-4e3d-9c76-8e0ca333d333 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:02.436617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1374278-b1b1-4e3d-9c76-8e0ca333d333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:02.438158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1374278-b1b1-4e3d-9c76-8e0ca333d333 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:02.443189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 496/994] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Oct 3 14:40:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:02.449191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09833c-f3cc-4162-bdb4-994a15740ddc None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:02.559494 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09833c-f3cc-4162-bdb4-994a15740ddc None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:02.562621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:02.598805 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfbfe7-dc10-4c8a-b65f-4b01bd6cb3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:02.599505 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfbfe7-dc10-4c8a-b65f-4b01bd6cb3f3 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:02.599746 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfbfe7-dc10-4c8a-b65f-4b01bd6cb3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:02.599988 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfbfe7-dc10-4c8a-b65f-4b01bd6cb3f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:02.600663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfbfe7-dc10-4c8a-b65f-4b01bd6cb3f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:02.602007 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfbfe7-dc10-4c8a-b65f-4b01bd6cb3f3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:02.618790 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 499/995] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:40:02 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:40:02.676682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe08996-806c-4206-8603-bfa9c2e77600 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:02.677213 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe08996-806c-4206-8603-bfa9c2e77600 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:02.677213 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe08996-806c-4206-8603-bfa9c2e77600 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:02.679344 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 497/996] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:40:02.686466 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53522e-8c58-4927-9569-f580a881a1a1 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:02.686769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53522e-8c58-4927-9569-f580a881a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:02.687069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53522e-8c58-4927-9569-f580a881a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:02.706193 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-8d53522e-8c58-4927-9569-f580a881a1a1 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:02.707433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-8d53522e-8c58-4927-9569-f580a881a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:02.792636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 500/997] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:03.068939 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe08996-806c-4206-8603-bfa9c2e77600 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:03.149831 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:03.182574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe08996-806c-4206-8603-bfa9c2e77600 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:03.217141 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38e9f-cb55-402a-aed4-4f69914d7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:03.217767 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38e9f-cb55-402a-aed4-4f69914d7edd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:03.218044 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38e9f-cb55-402a-aed4-4f69914d7edd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:03.218313 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa38e9f-cb55-402a-aed4-4f69914d7edd None admin] PATH_INFO: `/v3/services/compute` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:03.218884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38e9f-cb55-402a-aed4-4f69914d7edd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:03.220254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa38e9f-cb55-402a-aed4-4f69914d7edd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-6fa38e9f-cb55-402a-aed4-4f69914d7edd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:03.228864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:03.229843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:03.231838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 498/998] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:40:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:03.236878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53522e-8c58-4927-9569-f580a881a1a1 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:03.329145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:03.340002 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53522e-8c58-4927-9569-f580a881a1a1 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:03.374724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0fae1-4eb7-4f22-847a-74aa8c4582bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:03.375362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0fae1-4eb7-4f22-847a-74aa8c4582bb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:03.375641 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0fae1-4eb7-4f22-847a-74aa8c4582bb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:03.375915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0fae1-4eb7-4f22-847a-74aa8c4582bb None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:03.376540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0fae1-4eb7-4f22-847a-74aa8c4582bb None admin] RBAC: Adding query filter params (name=compute) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:03.376899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0fae1-4eb7-4f22-847a-74aa8c4582bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:03.378252 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0fae1-4eb7-4f22-847a-74aa8c4582bb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:03.387175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 501/999] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:40:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:03.390052 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38e9f-cb55-402a-aed4-4f69914d7edd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:03.501274 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa38e9f-cb55-402a-aed4-4f69914d7edd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:03.536744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0b5cd-57be-496b-b56f-523b4c162f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:03.537367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0b5cd-57be-496b-b56f-523b4c162f8f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:03.537652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0b5cd-57be-496b-b56f-523b4c162f8f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:03.537932 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0b5cd-57be-496b-b56f-523b4c162f8f None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:03.538559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0b5cd-57be-496b-b56f-523b4c162f8f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:03.538867 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0b5cd-57be-496b-b56f-523b4c162f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:03.540262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0b5cd-57be-496b-b56f-523b4c162f8f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:03.542398 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:03.547917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 499/1000] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:40:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:03.548552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb95a-99ab-487e-b608-212eb627821c None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:03.548940 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb95a-99ab-487e-b608-212eb627821c None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:03.549222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb95a-99ab-487e-b608-212eb627821c None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:03.550747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 502/1001] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:40:03.553967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0b5cd-57be-496b-b56f-523b4c162f8f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:03.556129 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba5e7-b471-466d-9df0-65d2e094a37a None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:03.556469 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba5e7-b471-466d-9df0-65d2e094a37a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:03.556742 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aba5e7-b471-466d-9df0-65d2e094a37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:03.575486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-55aba5e7-b471-466d-9df0-65d2e094a37a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:03.576852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-55aba5e7-b471-466d-9df0-65d2e094a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:03.646210 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 503/1002] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:40:03.662889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0b5cd-57be-496b-b56f-523b4c162f8f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:03.697396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c1d8-0384-46ad-b396-7472d7864d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:03.698060 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c1d8-0384-46ad-b396-7472d7864d7d None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:03.698287 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c1d8-0384-46ad-b396-7472d7864d7d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:03.698564 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c1d8-0384-46ad-b396-7472d7864d7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:03.700063 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6c1d8-0384-46ad-b396-7472d7864d7d None admin] RBAC: Adding query filter params (interface=public, service_id=71cc068c9d6c46f4bacf0a6bfb4c80eb, region_id=RegionOne) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:03.700380 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6c1d8-0384-46ad-b396-7472d7864d7d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:03.702011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6c1d8-0384-46ad-b396-7472d7864d7d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:03.707294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 500/1003] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Oct 3 14:40:03 2022] GET /identity/v3/endpoints?service_id=71cc068c9d6c46f4bacf0a6bfb4c80eb&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:03.712862 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aba5e7-b471-466d-9df0-65d2e094a37a None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:03.799615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:03.817384 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aba5e7-b471-466d-9df0-65d2e094a37a None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:03.851839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548eed4d-344e-47ec-bcb6-ba2fcf3472bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:03.852454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548eed4d-344e-47ec-bcb6-ba2fcf3472bd None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:03.852736 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548eed4d-344e-47ec-bcb6-ba2fcf3472bd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:03.853011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548eed4d-344e-47ec-bcb6-ba2fcf3472bd None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:03.853605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548eed4d-344e-47ec-bcb6-ba2fcf3472bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:03.854971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548eed4d-344e-47ec-bcb6-ba2fcf3472bd None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:03.861552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 504/1004] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Oct 3 14:40:03 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 14:40:03.917406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c1d8-0384-46ad-b396-7472d7864d7d None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:03.990327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:04.046020 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c1d8-0384-46ad-b396-7472d7864d7d None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:04.083399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6095b1-b269-4cda-becd-939e692a9783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:04.084043 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6095b1-b269-4cda-becd-939e692a9783 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:04.085006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6095b1-b269-4cda-becd-939e692a9783 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:04.085006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6095b1-b269-4cda-becd-939e692a9783 None admin] PATH_INFO: `/v3/services/image` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:04.085154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6095b1-b269-4cda-becd-939e692a9783 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:04.086494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6095b1-b269-4cda-becd-939e692a9783 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-2e6095b1-b269-4cda-becd-939e692a9783 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:04.100243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:04.101264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:04.102138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 501/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Oct 3 14:40:03 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:04.108715 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548eed4d-344e-47ec-bcb6-ba2fcf3472bd None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:04.210147 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548eed4d-344e-47ec-bcb6-ba2fcf3472bd None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:04.243481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee781ab4-3bd1-4b80-b39a-736b48b13eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:04.244134 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781ab4-3bd1-4b80-b39a-736b48b13eb2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:04.244416 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781ab4-3bd1-4b80-b39a-736b48b13eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:04.244737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781ab4-3bd1-4b80-b39a-736b48b13eb2 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:04.245619 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee781ab4-3bd1-4b80-b39a-736b48b13eb2 None admin] RBAC: Adding query filter params (name=image) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:04.245971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee781ab4-3bd1-4b80-b39a-736b48b13eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:04.247345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee781ab4-3bd1-4b80-b39a-736b48b13eb2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:04.256911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 505/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:04.258205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6095b1-b269-4cda-becd-939e692a9783 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:04.362751 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6095b1-b269-4cda-becd-939e692a9783 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:04.392973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:04.401947 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b866f0c-f796-48fc-b7ee-992e6baf46d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:04.402593 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866f0c-f796-48fc-b7ee-992e6baf46d5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:04.402875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866f0c-f796-48fc-b7ee-992e6baf46d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:04.403369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b866f0c-f796-48fc-b7ee-992e6baf46d5 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:04.403998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b866f0c-f796-48fc-b7ee-992e6baf46d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:04.404302 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b866f0c-f796-48fc-b7ee-992e6baf46d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:04.405654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b866f0c-f796-48fc-b7ee-992e6baf46d5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:04.419262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 502/1007] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:04.895025 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fef52-07ba-4b1d-8b28-7f9fd8e68693 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:04.895560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fef52-07ba-4b1d-8b28-7f9fd8e68693 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:04.895560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fef52-07ba-4b1d-8b28-7f9fd8e68693 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:04.897156 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 506/1008] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:04.902926 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f9076-71b5-4a96-9a15-fa7937a3e4d9 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:04.903608 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f9076-71b5-4a96-9a15-fa7937a3e4d9 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:04.903686 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f9076-71b5-4a96-9a15-fa7937a3e4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:04.922878 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-f19f9076-71b5-4a96-9a15-fa7937a3e4d9 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:04.924415 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-f19f9076-71b5-4a96-9a15-fa7937a3e4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:04.994128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 503/1009] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:04 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:05.263583 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fef52-07ba-4b1d-8b28-7f9fd8e68693 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:05.279372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:05.369802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fef52-07ba-4b1d-8b28-7f9fd8e68693 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:05.406234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d7c0e-4759-4e48-b54e-57450fd06a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:05.407090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d7c0e-4759-4e48-b54e-57450fd06a50 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:05.407372 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d7c0e-4759-4e48-b54e-57450fd06a50 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:05.407639 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d7c0e-4759-4e48-b54e-57450fd06a50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:05.408786 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d7c0e-4759-4e48-b54e-57450fd06a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:05.410185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d7c0e-4759-4e48-b54e-57450fd06a50 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:05.416714 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 507/1010] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:05.418461 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f9076-71b5-4a96-9a15-fa7937a3e4d9 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:05.517526 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f9076-71b5-4a96-9a15-fa7937a3e4d9 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:05.540438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:05.552448 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bc974-5a3a-4e2f-9682-31ccbb0ea8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:05.553057 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bc974-5a3a-4e2f-9682-31ccbb0ea8bf None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:05.553332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bc974-5a3a-4e2f-9682-31ccbb0ea8bf None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:05.553612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bc974-5a3a-4e2f-9682-31ccbb0ea8bf None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:05.554236 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bc974-5a3a-4e2f-9682-31ccbb0ea8bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:05.555663 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bc974-5a3a-4e2f-9682-31ccbb0ea8bf None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:05.588876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 504/1011] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:40:05 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:40:06.080097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2422e-5c6e-4555-8c60-1f97b6c322ee None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:06.080651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2422e-5c6e-4555-8c60-1f97b6c322ee None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:06.080651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2422e-5c6e-4555-8c60-1f97b6c322ee None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:06.082024 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 508/1012] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:06.087388 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15120684-b683-48b9-aae8-3f0abb480472 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:06.087841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15120684-b683-48b9-aae8-3f0abb480472 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:06.088039 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15120684-b683-48b9-aae8-3f0abb480472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:06.108970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-15120684-b683-48b9-aae8-3f0abb480472 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:06.110189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-15120684-b683-48b9-aae8-3f0abb480472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:06.177714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 505/1013] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:06.444724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2422e-5c6e-4555-8c60-1f97b6c322ee None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:06.535576 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:06.556775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2422e-5c6e-4555-8c60-1f97b6c322ee None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:06.591126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4135c2-8441-40f1-b248-463d67c3a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:06.591757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4135c2-8441-40f1-b248-463d67c3a883 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:06.592039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4135c2-8441-40f1-b248-463d67c3a883 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:06.592313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4135c2-8441-40f1-b248-463d67c3a883 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:06.592889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4135c2-8441-40f1-b248-463d67c3a883 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:06.594234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4135c2-8441-40f1-b248-463d67c3a883 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:06.601789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec6b3-2b31-42ad-836f-670e2b07d71d None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:06.602077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec6b3-2b31-42ad-836f-670e2b07d71d None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:06.602353 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec6b3-2b31-42ad-836f-670e2b07d71d None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-fb4135c2-8441-40f1-b248-463d67c3a883 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:06.603001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:06.603968 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 14:40:06.604838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:06.607265 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 506/1014] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:06.607339 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 509/1015] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:40:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:06.612454 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeec4e-59d9-4b7e-a91c-ff8863078fde None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:06.612791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeec4e-59d9-4b7e-a91c-ff8863078fde None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:06.613143 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeec4e-59d9-4b7e-a91c-ff8863078fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:06.613458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4135c2-8441-40f1-b248-463d67c3a883 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:06.633270 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-37eeec4e-59d9-4b7e-a91c-ff8863078fde None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:06.634550 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-37eeec4e-59d9-4b7e-a91c-ff8863078fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:06.702542 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 507/1016] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:06.718367 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4135c2-8441-40f1-b248-463d67c3a883 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:06.752390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7ac59-c318-4092-8fb1-4cdbed86e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:06.753366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7ac59-c318-4092-8fb1-4cdbed86e3dc None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:06.753842 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7ac59-c318-4092-8fb1-4cdbed86e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:06.754310 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb7ac59-c318-4092-8fb1-4cdbed86e3dc None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:06.755189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7ac59-c318-4092-8fb1-4cdbed86e3dc None admin] RBAC: Adding query filter params (name=compute) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:06.755623 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7ac59-c318-4092-8fb1-4cdbed86e3dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:06.757288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb7ac59-c318-4092-8fb1-4cdbed86e3dc None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:06.763041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 510/1017] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:40:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:06.768591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeec4e-59d9-4b7e-a91c-ff8863078fde None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:06.802935 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:06.872044 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeec4e-59d9-4b7e-a91c-ff8863078fde None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:06.905819 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ab0e9-1388-415c-9f8c-88ab4696ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:06.906437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ab0e9-1388-415c-9f8c-88ab4696ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:06.906777 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ab0e9-1388-415c-9f8c-88ab4696ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:06.907084 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ab0e9-1388-415c-9f8c-88ab4696ebd6 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:06.907711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ab0e9-1388-415c-9f8c-88ab4696ebd6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:06.908015 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ab0e9-1388-415c-9f8c-88ab4696ebd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:06.909375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ab0e9-1388-415c-9f8c-88ab4696ebd6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:06.919521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 508/1018] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Oct 3 14:40:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:06.920760 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7ac59-c318-4092-8fb1-4cdbed86e3dc None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:06.932213 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:06.987899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ab0e9-1388-415c-9f8c-88ab4696ebd6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:07.026643 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb7ac59-c318-4092-8fb1-4cdbed86e3dc None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:07.062653 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4f3d9-1771-4124-928e-d270637fc87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:07.063314 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4f3d9-1771-4124-928e-d270637fc87e None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:07.063596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4f3d9-1771-4124-928e-d270637fc87e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:07.063873 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4f3d9-1771-4124-928e-d270637fc87e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:07.064544 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4f3d9-1771-4124-928e-d270637fc87e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:07.065894 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4f3d9-1771-4124-928e-d270637fc87e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:07.098976 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 511/1019] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:40:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 14:40:07.099658 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:07.099658 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ab0e9-1388-415c-9f8c-88ab4696ebd6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:07.146904 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e53f-abe7-4314-b24d-d9f523d42079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:07.147658 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e53f-abe7-4314-b24d-d9f523d42079 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:07.148011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e53f-abe7-4314-b24d-d9f523d42079 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:07.148355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e53f-abe7-4314-b24d-d9f523d42079 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:07.149101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82e53f-abe7-4314-b24d-d9f523d42079 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:07.150567 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82e53f-abe7-4314-b24d-d9f523d42079 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:07.170994 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 509/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:40:06 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 14:40:07.811316 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb88db-0321-4a10-a94b-4fa7cdba5058 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:07.811609 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb88db-0321-4a10-a94b-4fa7cdba5058 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:07.811883 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb88db-0321-4a10-a94b-4fa7cdba5058 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:07.813256 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 512/1021] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:07.818425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6511-b312-4c1c-8ed0-cca529443e5a None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:07.818711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6511-b312-4c1c-8ed0-cca529443e5a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:07.819011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6511-b312-4c1c-8ed0-cca529443e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:07.837720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-57de6511-b312-4c1c-8ed0-cca529443e5a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:07.838889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-57de6511-b312-4c1c-8ed0-cca529443e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:07.912394 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 510/1022] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:08.184596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb88db-0321-4a10-a94b-4fa7cdba5058 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:08.249014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:08.289604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb88db-0321-4a10-a94b-4fa7cdba5058 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:08.323978 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6103-a968-4d41-ab3b-f17a659d42e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:08.324604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6103-a968-4d41-ab3b-f17a659d42e0 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:08.324884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6103-a968-4d41-ab3b-f17a659d42e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:08.325159 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6103-a968-4d41-ab3b-f17a659d42e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:08.326270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6103-a968-4d41-ab3b-f17a659d42e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:08.327723 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6103-a968-4d41-ab3b-f17a659d42e0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:08.330996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 513/1023] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:08.335233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6511-b312-4c1c-8ed0-cca529443e5a None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:08.419402 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:08.441365 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6511-b312-4c1c-8ed0-cca529443e5a None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:08.475587 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b637f7-096c-4c50-8535-31f0594f2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:08.476256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b637f7-096c-4c50-8535-31f0594f2958 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:08.476539 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b637f7-096c-4c50-8535-31f0594f2958 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:08.476802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b637f7-096c-4c50-8535-31f0594f2958 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:08.477460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b637f7-096c-4c50-8535-31f0594f2958 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:08.478867 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b637f7-096c-4c50-8535-31f0594f2958 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:08.501276 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 511/1024] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:40:08 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:40:09.354596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d068-7875-4f54-9edc-71eee739a4a8 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:09.355238 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d068-7875-4f54-9edc-71eee739a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:09.355238 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d068-7875-4f54-9edc-71eee739a4a8 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:09.358981 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 514/1025] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:09.362199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f01af-6a43-4b1c-9374-9485cf7ec539 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:09.362620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f01af-6a43-4b1c-9374-9485cf7ec539 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:09.362782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f01af-6a43-4b1c-9374-9485cf7ec539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:09.381993 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-c77f01af-6a43-4b1c-9374-9485cf7ec539 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:09.383532 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-c77f01af-6a43-4b1c-9374-9485cf7ec539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:09.385679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860d4d-4c51-4ae2-b392-8e9614815aea None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:09.385963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860d4d-4c51-4ae2-b392-8e9614815aea None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:09.386294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d860d4d-4c51-4ae2-b392-8e9614815aea None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:09.388023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 515/1026] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:09.393859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f270da-23fa-49ac-8872-a60af0d9155d None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:09.395208 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f270da-23fa-49ac-8872-a60af0d9155d None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:09.395763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f270da-23fa-49ac-8872-a60af0d9155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:09.428750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-70f270da-23fa-49ac-8872-a60af0d9155d None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:09.430432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-70f270da-23fa-49ac-8872-a60af0d9155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:09.475237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 512/1027] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:09.510358 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 516/1028] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:09.759584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f01af-6a43-4b1c-9374-9485cf7ec539 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:09.793384 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f270da-23fa-49ac-8872-a60af0d9155d None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:09.838348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:09.860732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:09.881553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f01af-6a43-4b1c-9374-9485cf7ec539 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:09.904962 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f270da-23fa-49ac-8872-a60af0d9155d None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:09.917632 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b640c8-2d97-4c5c-8876-8f1b15f3c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:09.918567 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b640c8-2d97-4c5c-8876-8f1b15f3c61f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:09.919023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b640c8-2d97-4c5c-8876-8f1b15f3c61f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:09.919520 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b640c8-2d97-4c5c-8876-8f1b15f3c61f None admin] PATH_INFO: `/v3/services/image` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:09.920241 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b640c8-2d97-4c5c-8876-8f1b15f3c61f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:09.921586 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b640c8-2d97-4c5c-8876-8f1b15f3c61f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-b9b640c8-2d97-4c5c-8876-8f1b15f3c61f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:09.931619 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:09.933517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:09.934616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 513/1029] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Oct 3 14:40:09 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:09.939034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b640c8-2d97-4c5c-8876-8f1b15f3c61f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:09.943405 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb2998-8157-42a0-a1c1-cb4eb312e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:09.944107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb2998-8157-42a0-a1c1-cb4eb312e863 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:09.944454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb2998-8157-42a0-a1c1-cb4eb312e863 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:09.944796 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb2998-8157-42a0-a1c1-cb4eb312e863 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:09.955782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb2998-8157-42a0-a1c1-cb4eb312e863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-72fb2998-8157-42a0-a1c1-cb4eb312e863 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:40:09.960634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:09.961572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:09.962426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 517/1030] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Oct 3 14:40:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:09.968445 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb2998-8157-42a0-a1c1-cb4eb312e863 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:10.040854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b640c8-2d97-4c5c-8876-8f1b15f3c61f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:10.069123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:10.073598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb2998-8157-42a0-a1c1-cb4eb312e863 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:10.075808 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c987e08-1d89-4b27-abbf-4aa9dab9997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:10.076421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c987e08-1d89-4b27-abbf-4aa9dab9997f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.076714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c987e08-1d89-4b27-abbf-4aa9dab9997f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.076971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c987e08-1d89-4b27-abbf-4aa9dab9997f None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.077594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c987e08-1d89-4b27-abbf-4aa9dab9997f None admin] RBAC: Adding query filter params (name=image) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:10.077902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c987e08-1d89-4b27-abbf-4aa9dab9997f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:10.079280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c987e08-1d89-4b27-abbf-4aa9dab9997f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:10.084339 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 514/1031] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:10.090243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c987e08-1d89-4b27-abbf-4aa9dab9997f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:10.110402 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:10.124500 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d1d0d-b9b9-44b8-9a1f-ab36d912918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:10.125279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1d0d-b9b9-44b8-9a1f-ab36d912918e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.125564 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1d0d-b9b9-44b8-9a1f-ab36d912918e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.125960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d1d0d-b9b9-44b8-9a1f-ab36d912918e None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.126599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d1d0d-b9b9-44b8-9a1f-ab36d912918e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:10.126903 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d1d0d-b9b9-44b8-9a1f-ab36d912918e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:10.128276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d1d0d-b9b9-44b8-9a1f-ab36d912918e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:10.139393 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 518/1032] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Oct 3 14:40:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:10.143204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d1d0d-b9b9-44b8-9a1f-ab36d912918e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:10.197927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c987e08-1d89-4b27-abbf-4aa9dab9997f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:10.233859 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa3f5a-139f-4359-b300-15cc894afc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:10.234477 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa3f5a-139f-4359-b300-15cc894afc0e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.234762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa3f5a-139f-4359-b300-15cc894afc0e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.235067 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa3f5a-139f-4359-b300-15cc894afc0e None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.235740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa3f5a-139f-4359-b300-15cc894afc0e None admin] RBAC: Adding query filter params (type=image) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:10.236035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa3f5a-139f-4359-b300-15cc894afc0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:10.237399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa3f5a-139f-4359-b300-15cc894afc0e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:10.242176 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 515/1033] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:10.248659 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa3f5a-139f-4359-b300-15cc894afc0e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:10.253653 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d1d0d-b9b9-44b8-9a1f-ab36d912918e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:10.291508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c4314-69aa-4756-a54c-3583edcf2273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:10.292363 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c4314-69aa-4756-a54c-3583edcf2273 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.293126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c4314-69aa-4756-a54c-3583edcf2273 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.293794 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c4314-69aa-4756-a54c-3583edcf2273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.307038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c4314-69aa-4756-a54c-3583edcf2273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:10.308830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c4314-69aa-4756-a54c-3583edcf2273 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:10.308959 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-6f2c4314-69aa-4756-a54c-3583edcf2273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:40:10.325133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:10.326207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:40:10.327556 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:40:10.327556 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:10.327556 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:10.331181 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 519/1034] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:10.331862 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c4314-69aa-4756-a54c-3583edcf2273 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:10.352791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa3f5a-139f-4359-b300-15cc894afc0e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:10.372409 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:10.388884 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86fe2-a316-4470-ae71-64957323e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:10.389562 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86fe2-a316-4470-ae71-64957323e8ab None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.389851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86fe2-a316-4470-ae71-64957323e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.390126 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d86fe2-a316-4470-ae71-64957323e8ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.390820 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d86fe2-a316-4470-ae71-64957323e8ab None admin] RBAC: Adding query filter params (interface=public, service_id=d19ac44bea4c40008c2205997416c421, region_id=RegionOne) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:10.391165 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d86fe2-a316-4470-ae71-64957323e8ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:10.392528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d86fe2-a316-4470-ae71-64957323e8ab None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:10.397620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 516/1035] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Oct 3 14:40:10 2022] GET /identity/v3/endpoints?service_id=d19ac44bea4c40008c2205997416c421&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:10.403668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86fe2-a316-4470-ae71-64957323e8ab None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:10.449597 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c4314-69aa-4756-a54c-3583edcf2273 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:10.488001 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4232e-a90e-4729-865a-4436ecfb0262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:10.488612 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4232e-a90e-4729-865a-4436ecfb0262 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.488893 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4232e-a90e-4729-865a-4436ecfb0262 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.489166 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4232e-a90e-4729-865a-4436ecfb0262 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.489804 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4232e-a90e-4729-865a-4436ecfb0262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:10.490104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4232e-a90e-4729-865a-4436ecfb0262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:10.491494 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4232e-a90e-4729-865a-4436ecfb0262 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:10.504455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 520/1036] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:10.510017 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4232e-a90e-4729-865a-4436ecfb0262 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:10.511851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d86fe2-a316-4470-ae71-64957323e8ab None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:10.537640 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:10.551415 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625894c-010d-44e4-ac8b-c96e8376191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:10.551961 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625894c-010d-44e4-ac8b-c96e8376191b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.552243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625894c-010d-44e4-ac8b-c96e8376191b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.552518 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625894c-010d-44e4-ac8b-c96e8376191b None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.553118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625894c-010d-44e4-ac8b-c96e8376191b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:10.554902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625894c-010d-44e4-ac8b-c96e8376191b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:10.570990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 517/1037] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Oct 3 14:40:10 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 14:40:10.626739 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:10.635551 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4232e-a90e-4729-865a-4436ecfb0262 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:10.674397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc906c-430d-42f1-8637-4a2e87962902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:10.675076 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc906c-430d-42f1-8637-4a2e87962902 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.675363 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc906c-430d-42f1-8637-4a2e87962902 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.675638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc906c-430d-42f1-8637-4a2e87962902 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.685254 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc906c-430d-42f1-8637-4a2e87962902 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:10.686715 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc906c-430d-42f1-8637-4a2e87962902 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-1bbc906c-430d-42f1-8637-4a2e87962902 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:40:10.700080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:10.701128 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:10.702074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 521/1038] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Oct 3 14:40:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:10.706827 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625894c-010d-44e4-ac8b-c96e8376191b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:10.740380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ddae4-8dbc-4c7c-b5a7-cfca3475e808 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.740656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ddae4-8dbc-4c7c-b5a7-cfca3475e808 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.740939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ddae4-8dbc-4c7c-b5a7-cfca3475e808 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.742278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 522/1039] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:40:10.748798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1289-9871-4e25-99dc-2b556364c057 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.749085 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1289-9871-4e25-99dc-2b556364c057 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.749365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1289-9871-4e25-99dc-2b556364c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.768775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-7d7a1289-9871-4e25-99dc-2b556364c057 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:10.769959 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-7d7a1289-9871-4e25-99dc-2b556364c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:10.821054 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625894c-010d-44e4-ac8b-c96e8376191b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:10.847455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 523/1040] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:40:10.856629 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61786e-ecc5-4dd2-b662-124bf746f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:10.857274 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61786e-ecc5-4dd2-b662-124bf746f61a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:10.857568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61786e-ecc5-4dd2-b662-124bf746f61a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:10.857847 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61786e-ecc5-4dd2-b662-124bf746f61a None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:10.858571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61786e-ecc5-4dd2-b662-124bf746f61a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:10.858880 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61786e-ecc5-4dd2-b662-124bf746f61a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:10.860342 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61786e-ecc5-4dd2-b662-124bf746f61a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:10.891065 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 518/1041] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Oct 3 14:40:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:10.892701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a1289-9871-4e25-99dc-2b556364c057 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:10.981657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:10.998899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a1289-9871-4e25-99dc-2b556364c057 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:11.032627 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1a7e6-9ff0-412b-be4d-cf235907ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:11.033236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1a7e6-9ff0-412b-be4d-cf235907ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:11.033513 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1a7e6-9ff0-412b-be4d-cf235907ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:11.033783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1a7e6-9ff0-412b-be4d-cf235907ebc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:11.109083 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1a7e6-9ff0-412b-be4d-cf235907ebc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:11.110521 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1a7e6-9ff0-412b-be4d-cf235907ebc9 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:11.123668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61786e-ecc5-4dd2-b662-124bf746f61a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:11.176701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:11.209930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:11.224496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 524/1042] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:11.230635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1a7e6-9ff0-412b-be4d-cf235907ebc9 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:11.239784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61786e-ecc5-4dd2-b662-124bf746f61a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:11.281446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5340a4-bef9-44fc-bb43-f8628eaaf6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:11.282383 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5340a4-bef9-44fc-bb43-f8628eaaf6ec None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:11.282670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5340a4-bef9-44fc-bb43-f8628eaaf6ec None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:11.283058 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5340a4-bef9-44fc-bb43-f8628eaaf6ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:11.296805 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5340a4-bef9-44fc-bb43-f8628eaaf6ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-db5340a4-bef9-44fc-bb43-f8628eaaf6ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:40:11.301661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:11.302618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:11.305042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 519/1043] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:11.308793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5340a4-bef9-44fc-bb43-f8628eaaf6ec None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:11.337220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1a7e6-9ff0-412b-be4d-cf235907ebc9 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:11.377067 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb247bbd-e317-4b26-9aeb-a1faa49eb167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:11.377701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb247bbd-e317-4b26-9aeb-a1faa49eb167 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:11.377883 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb247bbd-e317-4b26-9aeb-a1faa49eb167 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:11.378159 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb247bbd-e317-4b26-9aeb-a1faa49eb167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:11.389799 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb247bbd-e317-4b26-9aeb-a1faa49eb167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:11.391270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb247bbd-e317-4b26-9aeb-a1faa49eb167 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-cb247bbd-e317-4b26-9aeb-a1faa49eb167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:40:11.408546 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:11.409745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:40:11.410676 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:40:11.410676 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:11.410676 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:11.410676 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 525/1044] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:11.415146 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb247bbd-e317-4b26-9aeb-a1faa49eb167 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:11.420516 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5340a4-bef9-44fc-bb43-f8628eaaf6ec None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:11.423719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:11.459111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba837e-d364-42ad-a2d4-6ffe7e0375a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:11.459739 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba837e-d364-42ad-a2d4-6ffe7e0375a1 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:11.460024 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba837e-d364-42ad-a2d4-6ffe7e0375a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:11.460298 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba837e-d364-42ad-a2d4-6ffe7e0375a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:11.460974 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba837e-d364-42ad-a2d4-6ffe7e0375a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:11.461277 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba837e-d364-42ad-a2d4-6ffe7e0375a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:11.462320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:11.462669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba837e-d364-42ad-a2d4-6ffe7e0375a1 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:11.472570 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 520/1045] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:11.478170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba837e-d364-42ad-a2d4-6ffe7e0375a1 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:11.535973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb247bbd-e317-4b26-9aeb-a1faa49eb167 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:11.572581 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46f888-d192-4073-92e4-2879d301117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:11.573334 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46f888-d192-4073-92e4-2879d301117c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:11.574267 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46f888-d192-4073-92e4-2879d301117c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:11.574682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46f888-d192-4073-92e4-2879d301117c None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:11.575425 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46f888-d192-4073-92e4-2879d301117c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:11.575732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46f888-d192-4073-92e4-2879d301117c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:11.577134 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46f888-d192-4073-92e4-2879d301117c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:11.581360 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba837e-d364-42ad-a2d4-6ffe7e0375a1 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:11.593800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 526/1046] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:11.595059 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46f888-d192-4073-92e4-2879d301117c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:11.621171 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e47d7a-f7e2-45d4-a32e-90ff457772d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:11.621812 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e47d7a-f7e2-45d4-a32e-90ff457772d3 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:11.622097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e47d7a-f7e2-45d4-a32e-90ff457772d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:11.622378 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e47d7a-f7e2-45d4-a32e-90ff457772d3 None admin] PATH_INFO: `/v3/users/9d973273bffb41d3914fdf70d3e6e3e8` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:11.635847 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e47d7a-f7e2-45d4-a32e-90ff457772d3 None admin] RBAC: Authorizing `identity:get_user(user_id=9d973273bffb41d3914fdf70d3e6e3e8)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:11.637761 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e47d7a-f7e2-45d4-a32e-90ff457772d3 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:11.639468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 521/1047] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/users/9d973273bffb41d3914fdf70d3e6e3e8 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:11.645001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e47d7a-f7e2-45d4-a32e-90ff457772d3 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:11.671091 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:11.708628 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:11.713225 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46f888-d192-4073-92e4-2879d301117c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:11.751524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae541fc4-e11c-4dd8-96f7-84455f708654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:11.752431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae541fc4-e11c-4dd8-96f7-84455f708654 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:11.752575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e47d7a-f7e2-45d4-a32e-90ff457772d3 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:11.753051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae541fc4-e11c-4dd8-96f7-84455f708654 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:11.753475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae541fc4-e11c-4dd8-96f7-84455f708654 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:11.763442 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae541fc4-e11c-4dd8-96f7-84455f708654 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:11.765878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae541fc4-e11c-4dd8-96f7-84455f708654 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-ae541fc4-e11c-4dd8-96f7-84455f708654 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:40:11.778871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:11.779846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:11.780770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:40:11.780770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:40:11.780770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:40:11.780770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:40:11.780770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:40:11.780770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:40:11.780770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:40:11.780770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:11.785057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 527/1048] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:11.785910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae541fc4-e11c-4dd8-96f7-84455f708654 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:11.791663 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176dcb0-390d-479f-bb8f-fe9ecc929ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:11.792991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176dcb0-390d-479f-bb8f-fe9ecc929ec6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:11.793279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176dcb0-390d-479f-bb8f-fe9ecc929ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:11.793554 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176dcb0-390d-479f-bb8f-fe9ecc929ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:11.864449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176dcb0-390d-479f-bb8f-fe9ecc929ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:11.866033 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176dcb0-390d-479f-bb8f-fe9ecc929ec6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:11.891787 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae541fc4-e11c-4dd8-96f7-84455f708654 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:11.892591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:11.928411 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf1495-c7f6-40d7-b080-8c6408479c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:11.929126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf1495-c7f6-40d7-b080-8c6408479c2e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:11.929414 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf1495-c7f6-40d7-b080-8c6408479c2e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:11.929690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf1495-c7f6-40d7-b080-8c6408479c2e None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:11.930378 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf1495-c7f6-40d7-b080-8c6408479c2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:11.930925 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf1495-c7f6-40d7-b080-8c6408479c2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:11.932126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf1495-c7f6-40d7-b080-8c6408479c2e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:11.944971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 528/1049] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:11.951782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf1495-c7f6-40d7-b080-8c6408479c2e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:11.972477 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:11.981891 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 522/1050] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 14:40:11.983644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176dcb0-390d-479f-bb8f-fe9ecc929ec6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:12.057230 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf1495-c7f6-40d7-b080-8c6408479c2e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:12.096956 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acf08f-f14e-49fa-a807-bca1758f4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:12.097567 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acf08f-f14e-49fa-a807-bca1758f4681 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:12.097850 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acf08f-f14e-49fa-a807-bca1758f4681 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:12.098125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acf08f-f14e-49fa-a807-bca1758f4681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:12.098544 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176dcb0-390d-479f-bb8f-fe9ecc929ec6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:12.098844 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acf08f-f14e-49fa-a807-bca1758f4681 None admin] RBAC: Adding query filter params (role.id=3078f35bd776448fae317ac755cbac23, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=bfb0254e89514ff18e1c91dc427e4b1e) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:12.099181 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acf08f-f14e-49fa-a807-bca1758f4681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:12.100593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acf08f-f14e-49fa-a807-bca1758f4681 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:12.106108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 529/1051] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/role_assignments?user.id=bfb0254e89514ff18e1c91dc427e4b1e&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=3078f35bd776448fae317ac755cbac23 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:12.136966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:12.149593 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8865f1-e9e6-43ae-ba64-0290ec528bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:12.150246 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8865f1-e9e6-43ae-ba64-0290ec528bce None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:12.150592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8865f1-e9e6-43ae-ba64-0290ec528bce None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:12.150936 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8865f1-e9e6-43ae-ba64-0290ec528bce None admin] PATH_INFO: `/v3/projects/f7300d09d45040c6ada3bc8023187270` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:12.152194 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8865f1-e9e6-43ae-ba64-0290ec528bce None admin] RBAC: Authorizing `identity:get_project(project_id=f7300d09d45040c6ada3bc8023187270)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:12.153827 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8865f1-e9e6-43ae-ba64-0290ec528bce None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:12.155793 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 523/1052] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:40:11 2022] GET /identity/v3/projects/f7300d09d45040c6ada3bc8023187270 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:12.161818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acf08f-f14e-49fa-a807-bca1758f4681 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:12.253081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:12.273981 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acf08f-f14e-49fa-a807-bca1758f4681 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:12.311043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6da22-e834-45b4-91fe-7b2ae421bb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:12.311655 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6da22-e834-45b4-91fe-7b2ae421bb1c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:12.311942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6da22-e834-45b4-91fe-7b2ae421bb1c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:12.312218 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6da22-e834-45b4-91fe-7b2ae421bb1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:12.312945 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6da22-e834-45b4-91fe-7b2ae421bb1c None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=f7300d09d45040c6ada3bc8023187270, user.id=9d973273bffb41d3914fdf70d3e6e3e8) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:12.313259 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6da22-e834-45b4-91fe-7b2ae421bb1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:12.314676 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6da22-e834-45b4-91fe-7b2ae421bb1c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:12.320403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 530/1053] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:40:12 2022] GET /identity/v3/role_assignments?user.id=9d973273bffb41d3914fdf70d3e6e3e8&scope.project.id=f7300d09d45040c6ada3bc8023187270&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:12.793816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd181bf-1e0c-4aee-8fcf-9c0b54ae9bfb None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:12.794354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd181bf-1e0c-4aee-8fcf-9c0b54ae9bfb None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:12.794354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd181bf-1e0c-4aee-8fcf-9c0b54ae9bfb None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:12.795976 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 524/1054] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:12.800990 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b4ae-9c71-4693-bd94-4319eabd5242 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:12.801378 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b4ae-9c71-4693-bd94-4319eabd5242 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:12.801573 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b4ae-9c71-4693-bd94-4319eabd5242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:12.821122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-f2b6b4ae-9c71-4693-bd94-4319eabd5242 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:12.822307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-f2b6b4ae-9c71-4693-bd94-4319eabd5242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:12.893816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 531/1055] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:13.175918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd181bf-1e0c-4aee-8fcf-9c0b54ae9bfb None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:13.286937 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd181bf-1e0c-4aee-8fcf-9c0b54ae9bfb None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:13.321053 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fa585-3b5e-4a25-b683-894a92a3b7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:13.321681 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fa585-3b5e-4a25-b683-894a92a3b7be None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:13.321960 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fa585-3b5e-4a25-b683-894a92a3b7be None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:13.322235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fa585-3b5e-4a25-b683-894a92a3b7be None admin] PATH_INFO: `/v3/services/image` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:13.322812 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fa585-3b5e-4a25-b683-894a92a3b7be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:13.325366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fa585-3b5e-4a25-b683-894a92a3b7be None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-967fa585-3b5e-4a25-b683-894a92a3b7be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:13.334505 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:13.335553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:13.340652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 525/1056] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Oct 3 14:40:13 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:13.343727 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b4ae-9c71-4693-bd94-4319eabd5242 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:13.423200 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:13.447419 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b4ae-9c71-4693-bd94-4319eabd5242 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:13.482767 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5347213-0988-45fd-b03d-eda6adacbcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:13.483408 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5347213-0988-45fd-b03d-eda6adacbcb3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:13.483689 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5347213-0988-45fd-b03d-eda6adacbcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:13.483960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5347213-0988-45fd-b03d-eda6adacbcb3 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:13.484579 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5347213-0988-45fd-b03d-eda6adacbcb3 None admin] RBAC: Adding query filter params (name=image) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:13.484877 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5347213-0988-45fd-b03d-eda6adacbcb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:13.486213 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5347213-0988-45fd-b03d-eda6adacbcb3 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:13.491200 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 532/1057] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:13.497076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fa585-3b5e-4a25-b683-894a92a3b7be None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:13.556644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:13.602753 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fa585-3b5e-4a25-b683-894a92a3b7be None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:13.637154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc0146-0632-4b83-9cdd-25d55f9a670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:13.637810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0146-0632-4b83-9cdd-25d55f9a670c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:13.638087 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0146-0632-4b83-9cdd-25d55f9a670c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:13.638356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0146-0632-4b83-9cdd-25d55f9a670c None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:13.639050 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0146-0632-4b83-9cdd-25d55f9a670c None admin] RBAC: Adding query filter params (type=image) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:13.639423 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0146-0632-4b83-9cdd-25d55f9a670c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:13.640761 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0146-0632-4b83-9cdd-25d55f9a670c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:13.645757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 526/1058] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:13.651139 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5347213-0988-45fd-b03d-eda6adacbcb3 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:13.749575 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5347213-0988-45fd-b03d-eda6adacbcb3 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:13.782481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1417f-322f-4aa5-be85-0f259e034d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:13.783108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1417f-322f-4aa5-be85-0f259e034d44 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:13.783388 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1417f-322f-4aa5-be85-0f259e034d44 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:13.783655 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1417f-322f-4aa5-be85-0f259e034d44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:13.784315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1417f-322f-4aa5-be85-0f259e034d44 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:13.785652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1417f-322f-4aa5-be85-0f259e034d44 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:13.794819 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:13.807646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 533/1059] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:40:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:40:14.310474 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d9cb-e0ba-4650-b07c-260909dcc87e None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:14.311042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d9cb-e0ba-4650-b07c-260909dcc87e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:14.311042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9d9cb-e0ba-4650-b07c-260909dcc87e None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:14.312672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 527/1060] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:14.317839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6181fde-3362-4e05-9073-ddbce8a98542 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:14.318137 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6181fde-3362-4e05-9073-ddbce8a98542 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:14.318412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6181fde-3362-4e05-9073-ddbce8a98542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:14.337342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-f6181fde-3362-4e05-9073-ddbce8a98542 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:14.338583 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-f6181fde-3362-4e05-9073-ddbce8a98542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:14.416340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 534/1061] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:14.494387 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c681f55-3c65-4988-96f8-3f8f1ccc9f5a None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:14.494730 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c681f55-3c65-4988-96f8-3f8f1ccc9f5a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:14.495215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c681f55-3c65-4988-96f8-3f8f1ccc9f5a None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:14.497611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 528/1062] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:14.502632 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda536b-3893-4c79-a287-30affa86c094 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:14.503007 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda536b-3893-4c79-a287-30affa86c094 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:14.503289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda536b-3893-4c79-a287-30affa86c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:14.522342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-bcda536b-3893-4c79-a287-30affa86c094 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:14.523575 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-bcda536b-3893-4c79-a287-30affa86c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:14.592617 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 535/1063] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:14.687733 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c681f55-3c65-4988-96f8-3f8f1ccc9f5a None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:14.791672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c681f55-3c65-4988-96f8-3f8f1ccc9f5a None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:14.811518 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:14.826599 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d03873-dd2c-49df-9bc0-86041d17475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:14.827304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d03873-dd2c-49df-9bc0-86041d17475e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:14.827573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d03873-dd2c-49df-9bc0-86041d17475e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:14.827843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d03873-dd2c-49df-9bc0-86041d17475e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:14.837803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d03873-dd2c-49df-9bc0-86041d17475e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-43d03873-dd2c-49df-9bc0-86041d17475e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:40:14.843254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:14.844163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:40:14.845011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:14.847285 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 529/1064] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Oct 3 14:40:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:14.850175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda536b-3893-4c79-a287-30affa86c094 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:14.862859 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d03873-dd2c-49df-9bc0-86041d17475e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:14.908660 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:14.962757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda536b-3893-4c79-a287-30affa86c094 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:14.965709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d03873-dd2c-49df-9bc0-86041d17475e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.001048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33af855-5e5f-4f38-8261-6bf4ee01c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.001463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d28c2-7280-4a73-bed6-d3cf6ec9d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.001688 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33af855-5e5f-4f38-8261-6bf4ee01c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.001971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33af855-5e5f-4f38-8261-6bf4ee01c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.002085 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d28c2-7280-4a73-bed6-d3cf6ec9d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.002256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33af855-5e5f-4f38-8261-6bf4ee01c3a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.002371 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d28c2-7280-4a73-bed6-d3cf6ec9d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.002619 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d28c2-7280-4a73-bed6-d3cf6ec9d7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.003329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d28c2-7280-4a73-bed6-d3cf6ec9d7d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:15.003629 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d28c2-7280-4a73-bed6-d3cf6ec9d7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.005848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d28c2-7280-4a73-bed6-d3cf6ec9d7d2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.014477 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 536/1065] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Oct 3 14:40:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:15.019785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33af855-5e5f-4f38-8261-6bf4ee01c3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:40:15.020033 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d28c2-7280-4a73-bed6-d3cf6ec9d7d2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-b33af855-5e5f-4f38-8261-6bf4ee01c3a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:40:15.024591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:15.025528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:15.026389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:15.031359 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 530/1066] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:15.032134 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33af855-5e5f-4f38-8261-6bf4ee01c3a8 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:15.079271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:15.143205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d28c2-7280-4a73-bed6-d3cf6ec9d7d2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.144174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33af855-5e5f-4f38-8261-6bf4ee01c3a8 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.157515 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:15.180646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32005f96-f633-4551-8c57-63f41dd9e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.181279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32005f96-f633-4551-8c57-63f41dd9e02a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.181556 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32005f96-f633-4551-8c57-63f41dd9e02a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.181827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32005f96-f633-4551-8c57-63f41dd9e02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.191375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7938c18-dc93-44b7-9838-6d9819afb2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.192220 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7938c18-dc93-44b7-9838-6d9819afb2ca None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.192664 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7938c18-dc93-44b7-9838-6d9819afb2ca None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.193087 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7938c18-dc93-44b7-9838-6d9819afb2ca None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.193539 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32005f96-f633-4551-8c57-63f41dd9e02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.194074 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7938c18-dc93-44b7-9838-6d9819afb2ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:15.194525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7938c18-dc93-44b7-9838-6d9819afb2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.194969 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32005f96-f633-4551-8c57-63f41dd9e02a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.196207 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7938c18-dc93-44b7-9838-6d9819afb2ca None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.205229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 531/1067] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:40:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-32005f96-f633-4551-8c57-63f41dd9e02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:40:15.208983 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:15.209996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:40:15.211182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:40:15.211182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:15.211182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:15.212272 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7938c18-dc93-44b7-9838-6d9819afb2ca None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:15.215595 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 537/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:15.216416 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32005f96-f633-4551-8c57-63f41dd9e02a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:15.314400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7938c18-dc93-44b7-9838-6d9819afb2ca None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.316015 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:15.326608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32005f96-f633-4551-8c57-63f41dd9e02a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.351092 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96148133-a69d-4144-ab83-69155508f8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.351858 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148133-a69d-4144-ab83-69155508f8fd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.352134 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148133-a69d-4144-ab83-69155508f8fd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.352405 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148133-a69d-4144-ab83-69155508f8fd None admin] PATH_INFO: `/v3/users/9d973273bffb41d3914fdf70d3e6e3e8` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.353597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96148133-a69d-4144-ab83-69155508f8fd None admin] RBAC: Authorizing `identity:get_user(user_id=9d973273bffb41d3914fdf70d3e6e3e8)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.355312 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96148133-a69d-4144-ab83-69155508f8fd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.361678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 532/1069] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:15 2022] GET /identity/v3/users/9d973273bffb41d3914fdf70d3e6e3e8 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:15.362529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96148133-a69d-4144-ab83-69155508f8fd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:15.364265 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207046e-14d2-47eb-b881-25f8a79974b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.364877 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207046e-14d2-47eb-b881-25f8a79974b5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.365154 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207046e-14d2-47eb-b881-25f8a79974b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.365428 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207046e-14d2-47eb-b881-25f8a79974b5 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.366065 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207046e-14d2-47eb-b881-25f8a79974b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:15.366364 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207046e-14d2-47eb-b881-25f8a79974b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.367735 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207046e-14d2-47eb-b881-25f8a79974b5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.385169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 538/1070] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:15.386717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207046e-14d2-47eb-b881-25f8a79974b5 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:15.415459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:15.469204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96148133-a69d-4144-ab83-69155508f8fd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.502758 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207046e-14d2-47eb-b881-25f8a79974b5 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.506658 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c87c6d-098e-49f8-8848-c7a174fe5bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.507508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c87c6d-098e-49f8-8848-c7a174fe5bdb None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.508034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c87c6d-098e-49f8-8848-c7a174fe5bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.508455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c87c6d-098e-49f8-8848-c7a174fe5bdb None admin] PATH_INFO: `/v3/projects/f7300d09d45040c6ada3bc8023187270` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.509696 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c87c6d-098e-49f8-8848-c7a174fe5bdb None admin] RBAC: Authorizing `identity:get_project(project_id=f7300d09d45040c6ada3bc8023187270)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.511920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c87c6d-098e-49f8-8848-c7a174fe5bdb None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.513776 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 533/1071] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:40:15 2022] GET /identity/v3/projects/f7300d09d45040c6ada3bc8023187270 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:15.520652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c87c6d-098e-49f8-8848-c7a174fe5bdb None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:15.546347 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428083d7-f7bd-4efa-822f-d01e6db34d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.547027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428083d7-f7bd-4efa-822f-d01e6db34d3e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.547308 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428083d7-f7bd-4efa-822f-d01e6db34d3e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.547575 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428083d7-f7bd-4efa-822f-d01e6db34d3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.554776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428083d7-f7bd-4efa-822f-d01e6db34d3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.556220 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428083d7-f7bd-4efa-822f-d01e6db34d3e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.561595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-428083d7-f7bd-4efa-822f-d01e6db34d3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:40:15.568362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:15.569365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:15.570890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 539/1072] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Oct 3 14:40:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:15.575804 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428083d7-f7bd-4efa-822f-d01e6db34d3e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:15.629191 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c87c6d-098e-49f8-8848-c7a174fe5bdb None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.664791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ffce3-dab4-4ad0-b6bc-7c6c6fe0e984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.665634 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffce3-dab4-4ad0-b6bc-7c6c6fe0e984 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.665929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffce3-dab4-4ad0-b6bc-7c6c6fe0e984 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.666278 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ffce3-dab4-4ad0-b6bc-7c6c6fe0e984 None admin] PATH_INFO: `/v3/projects/f7300d09d45040c6ada3bc8023187270/users/9d973273bffb41d3914fdf70d3e6e3e8/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.668562 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:15.670266 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ffce3-dab4-4ad0-b6bc-7c6c6fe0e984 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7300d09d45040c6ada3bc8023187270, user_id=9d973273bffb41d3914fdf70d3e6e3e8, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.671831 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ffce3-dab4-4ad0-b6bc-7c6c6fe0e984 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.685229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428083d7-f7bd-4efa-822f-d01e6db34d3e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.695315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 534/1073] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:40:15 2022] PUT /identity/v3/projects/f7300d09d45040c6ada3bc8023187270/users/9d973273bffb41d3914fdf70d3e6e3e8/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 14:40:15.722865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab98dd-1856-48fd-b339-1f3d246a84cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.723677 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab98dd-1856-48fd-b339-1f3d246a84cb None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.724055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab98dd-1856-48fd-b339-1f3d246a84cb None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.724423 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab98dd-1856-48fd-b339-1f3d246a84cb None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.725290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab98dd-1856-48fd-b339-1f3d246a84cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:15.725697 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab98dd-1856-48fd-b339-1f3d246a84cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.727358 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab98dd-1856-48fd-b339-1f3d246a84cb None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.748841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 540/1074] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Oct 3 14:40:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:15.754558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ffce3-dab4-4ad0-b6bc-7c6c6fe0e984 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:15.866755 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:15.871600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ffce3-dab4-4ad0-b6bc-7c6c6fe0e984 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:15.908762 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8d6f2-b32b-41b6-8339-bc6fb0bedb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:15.909484 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8d6f2-b32b-41b6-8339-bc6fb0bedb04 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:15.909768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8d6f2-b32b-41b6-8339-bc6fb0bedb04 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:15.910041 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8d6f2-b32b-41b6-8339-bc6fb0bedb04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:15.922874 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8d6f2-b32b-41b6-8339-bc6fb0bedb04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:15.924297 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8d6f2-b32b-41b6-8339-bc6fb0bedb04 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-2fb8d6f2-b32b-41b6-8339-bc6fb0bedb04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:40:15.942034 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:15.943135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:40:15.944071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:40:15.944071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:15.944071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:15.944071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 535/1075] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:15.948848 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab98dd-1856-48fd-b339-1f3d246a84cb None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:16.034684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbad1b5-b57f-4c25-851c-73acd54a2e01 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:16.035361 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbad1b5-b57f-4c25-851c-73acd54a2e01 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:16.035667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbad1b5-b57f-4c25-851c-73acd54a2e01 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:16.037748 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 536/1076] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:40:16.042495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb2734-052c-4cf0-bc3d-0ff011fb0db1 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:16.042779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb2734-052c-4cf0-bc3d-0ff011fb0db1 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:16.043095 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb2734-052c-4cf0-bc3d-0ff011fb0db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:16.054596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab98dd-1856-48fd-b339-1f3d246a84cb None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:16.061362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-bacb2734-052c-4cf0-bc3d-0ff011fb0db1 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:16.062538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-bacb2734-052c-4cf0-bc3d-0ff011fb0db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:16.094691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d1f38-9f34-4076-a19b-39f95d9e6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:16.095444 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d1f38-9f34-4076-a19b-39f95d9e6c95 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:16.095725 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d1f38-9f34-4076-a19b-39f95d9e6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:16.096353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d1f38-9f34-4076-a19b-39f95d9e6c95 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:16.096810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d1f38-9f34-4076-a19b-39f95d9e6c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:16.097145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d1f38-9f34-4076-a19b-39f95d9e6c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:16.098638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d1f38-9f34-4076-a19b-39f95d9e6c95 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:16.110455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 541/1077] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:16.115700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d1f38-9f34-4076-a19b-39f95d9e6c95 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:16.119824 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:16.150995 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 537/1078] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:40:16.227009 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d1f38-9f34-4076-a19b-39f95d9e6c95 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:16.261659 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadb81a-bed8-4e7f-b3c4-9d62ed621f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:16.262365 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadb81a-bed8-4e7f-b3c4-9d62ed621f47 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:16.262648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadb81a-bed8-4e7f-b3c4-9d62ed621f47 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:16.262923 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadb81a-bed8-4e7f-b3c4-9d62ed621f47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:16.269510 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadb81a-bed8-4e7f-b3c4-9d62ed621f47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:16.270939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadb81a-bed8-4e7f-b3c4-9d62ed621f47 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-2eadb81a-bed8-4e7f-b3c4-9d62ed621f47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:40:16.282696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:16.283657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:16.284596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:40:16.284596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:40:16.284596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:40:16.284596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:40:16.284596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:40:16.284596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:40:16.284596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:40:16.284596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:16.284596 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 542/1079] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:16.289593 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb2734-052c-4cf0-bc3d-0ff011fb0db1 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:16.374387 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:16.400955 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb2734-052c-4cf0-bc3d-0ff011fb0db1 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:16.428613 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadb81a-bed8-4e7f-b3c4-9d62ed621f47 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:16.438506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab5c1a-7284-43f2-9d02-a492554f8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:16.439152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab5c1a-7284-43f2-9d02-a492554f8652 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:16.439438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab5c1a-7284-43f2-9d02-a492554f8652 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:16.439713 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab5c1a-7284-43f2-9d02-a492554f8652 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:16.440406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab5c1a-7284-43f2-9d02-a492554f8652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:16.440711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab5c1a-7284-43f2-9d02-a492554f8652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:16.442130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab5c1a-7284-43f2-9d02-a492554f8652 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:16.461537 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 538/1080] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:16.462529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab5c1a-7284-43f2-9d02-a492554f8652 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:16.504966 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:16.545602 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadb81a-bed8-4e7f-b3c4-9d62ed621f47 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:16.572931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab5c1a-7284-43f2-9d02-a492554f8652 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:16.582167 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e594-b154-4b65-93ab-cdf0be405f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:16.582802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e594-b154-4b65-93ab-cdf0be405f0e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:16.583116 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e594-b154-4b65-93ab-cdf0be405f0e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:16.583394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2e594-b154-4b65-93ab-cdf0be405f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:16.611356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2eb1e6-2029-43aa-be20-1fbca7875d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:16.612470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2eb1e6-2029-43aa-be20-1fbca7875d4a None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:16.612997 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2eb1e6-2029-43aa-be20-1fbca7875d4a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:16.613479 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2eb1e6-2029-43aa-be20-1fbca7875d4a None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/bfb0254e89514ff18e1c91dc427e4b1e/roles/3078f35bd776448fae317ac755cbac23` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:16.616036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2eb1e6-2029-43aa-be20-1fbca7875d4a None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=bfb0254e89514ff18e1c91dc427e4b1e, role_id=3078f35bd776448fae317ac755cbac23)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:16.618043 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2eb1e6-2029-43aa-be20-1fbca7875d4a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:16.629855 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:16.637029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 539/1081] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:40:16 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/bfb0254e89514ff18e1c91dc427e4b1e/roles/3078f35bd776448fae317ac755cbac23 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 14:40:16.665932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2e594-b154-4b65-93ab-cdf0be405f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:16.668056 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2e594-b154-4b65-93ab-cdf0be405f0e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:16.735662 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:16.783100 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 543/1082] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:16.785844 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2eb1e6-2029-43aa-be20-1fbca7875d4a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:16.894853 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2eb1e6-2029-43aa-be20-1fbca7875d4a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:16.928664 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d952f-3426-4598-ba58-558ac597add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:16.929304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d952f-3426-4598-ba58-558ac597add5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:16.929589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d952f-3426-4598-ba58-558ac597add5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:16.929867 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d952f-3426-4598-ba58-558ac597add5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:16.941201 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d952f-3426-4598-ba58-558ac597add5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:16.942660 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d952f-3426-4598-ba58-558ac597add5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-ed2d952f-3426-4598-ba58-558ac597add5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:40:16.957174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:16.958244 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:40:16.959321 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:40:16.959321 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:16.959321 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:16.959321 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 540/1083] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:16.964433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e594-b154-4b65-93ab-cdf0be405f0e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:17.068417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2e594-b154-4b65-93ab-cdf0be405f0e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:17.110915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf68fd-5a50-4937-8fd2-f848c1d41cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:17.111549 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf68fd-5a50-4937-8fd2-f848c1d41cea None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:17.111826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf68fd-5a50-4937-8fd2-f848c1d41cea None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:17.112092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf68fd-5a50-4937-8fd2-f848c1d41cea None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:17.112717 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf68fd-5a50-4937-8fd2-f848c1d41cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:17.113014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf68fd-5a50-4937-8fd2-f848c1d41cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:17.114342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf68fd-5a50-4937-8fd2-f848c1d41cea None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:17.127657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 544/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:17.909360 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242bc4b-a485-4e6b-8e30-96bf59291233 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:17.911308 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242bc4b-a485-4e6b-8e30-96bf59291233 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:17.911308 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242bc4b-a485-4e6b-8e30-96bf59291233 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:17.911308 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 541/1085] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:17.916468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f575-9107-4ffb-97e5-545417a0785e None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:17.916844 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f575-9107-4ffb-97e5-545417a0785e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:17.917251 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f575-9107-4ffb-97e5-545417a0785e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:17.935386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-55d6f575-9107-4ffb-97e5-545417a0785e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:17.936563 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-55d6f575-9107-4ffb-97e5-545417a0785e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:17.954159 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:18.002602 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 545/1086] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:18.279146 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242bc4b-a485-4e6b-8e30-96bf59291233 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:18.332196 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:18.380393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242bc4b-a485-4e6b-8e30-96bf59291233 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:18.414557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf984936-aa0e-4c45-9571-dae18ca6221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:18.415218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf984936-aa0e-4c45-9571-dae18ca6221c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:18.415500 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf984936-aa0e-4c45-9571-dae18ca6221c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:18.415773 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf984936-aa0e-4c45-9571-dae18ca6221c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:18.426194 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf984936-aa0e-4c45-9571-dae18ca6221c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-cf984936-aa0e-4c45-9571-dae18ca6221c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:40:18.430919 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:18.432105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:18.433182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 542/1087] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:18.438023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f575-9107-4ffb-97e5-545417a0785e None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:18.537547 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f575-9107-4ffb-97e5-545417a0785e None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:18.570787 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182889ee-5094-45b7-99d7-e7f3ffad91c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:18.571422 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182889ee-5094-45b7-99d7-e7f3ffad91c2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:18.571701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182889ee-5094-45b7-99d7-e7f3ffad91c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:18.571970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182889ee-5094-45b7-99d7-e7f3ffad91c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:18.572615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182889ee-5094-45b7-99d7-e7f3ffad91c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:18.572915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182889ee-5094-45b7-99d7-e7f3ffad91c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:18.575115 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182889ee-5094-45b7-99d7-e7f3ffad91c2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:18.582938 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 546/1088] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:40:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:18.588840 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf984936-aa0e-4c45-9571-dae18ca6221c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:18.689723 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf984936-aa0e-4c45-9571-dae18ca6221c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:18.704985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:18.729152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd88207-2129-41c2-9dcf-bd09a97e4e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:18.729851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd88207-2129-41c2-9dcf-bd09a97e4e97 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:18.730344 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd88207-2129-41c2-9dcf-bd09a97e4e97 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:18.730763 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd88207-2129-41c2-9dcf-bd09a97e4e97 None admin] PATH_INFO: `/v3/users/9d973273bffb41d3914fdf70d3e6e3e8` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:18.731969 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd88207-2129-41c2-9dcf-bd09a97e4e97 None admin] RBAC: Authorizing `identity:get_user(user_id=9d973273bffb41d3914fdf70d3e6e3e8)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:18.733417 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd88207-2129-41c2-9dcf-bd09a97e4e97 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:18.739743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 543/1089] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:18 2022] GET /identity/v3/users/9d973273bffb41d3914fdf70d3e6e3e8 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:18.740890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182889ee-5094-45b7-99d7-e7f3ffad91c2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:18.759810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:18.821937 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7884-80c4-4baf-b608-e35d88a83a26 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:18.822137 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7884-80c4-4baf-b608-e35d88a83a26 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:18.822398 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7884-80c4-4baf-b608-e35d88a83a26 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:18.824365 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 544/1090] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:40:18.829448 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c88b0-8837-4cde-bf0b-aea5171dfd23 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:18.829737 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c88b0-8837-4cde-bf0b-aea5171dfd23 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:18.830014 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c88b0-8837-4cde-bf0b-aea5171dfd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:18.842027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182889ee-5094-45b7-99d7-e7f3ffad91c2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:18.847936 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-ec7c88b0-8837-4cde-bf0b-aea5171dfd23 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:18.849124 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-ec7c88b0-8837-4cde-bf0b-aea5171dfd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:18.876514 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96d66c-753f-4cda-bac5-f6177484d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:18.877112 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96d66c-753f-4cda-bac5-f6177484d5a2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:18.877392 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96d66c-753f-4cda-bac5-f6177484d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:18.877665 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96d66c-753f-4cda-bac5-f6177484d5a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:18.914223 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 545/1091] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:40:18.944871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96d66c-753f-4cda-bac5-f6177484d5a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:18.946302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96d66c-753f-4cda-bac5-f6177484d5a2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:18.963409 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:19.042847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 547/1092] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:19.048779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c88b0-8837-4cde-bf0b-aea5171dfd23 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:19.152759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c88b0-8837-4cde-bf0b-aea5171dfd23 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:19.163088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:19.182478 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96d66c-753f-4cda-bac5-f6177484d5a2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:19.188643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acb642-61bd-46f6-8f2f-3a4b8aada7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:19.189304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acb642-61bd-46f6-8f2f-3a4b8aada7ad None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:19.189584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acb642-61bd-46f6-8f2f-3a4b8aada7ad None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:19.189855 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acb642-61bd-46f6-8f2f-3a4b8aada7ad None admin] PATH_INFO: `/v3/projects/f7300d09d45040c6ada3bc8023187270` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:19.190972 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acb642-61bd-46f6-8f2f-3a4b8aada7ad None admin] RBAC: Authorizing `identity:get_project(project_id=f7300d09d45040c6ada3bc8023187270)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:19.192375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acb642-61bd-46f6-8f2f-3a4b8aada7ad None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:19.194134 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 546/1093] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:40:19 2022] GET /identity/v3/projects/f7300d09d45040c6ada3bc8023187270 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:19.200612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acb642-61bd-46f6-8f2f-3a4b8aada7ad None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:19.281613 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96d66c-753f-4cda-bac5-f6177484d5a2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:19.298030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:19.305591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acb642-61bd-46f6-8f2f-3a4b8aada7ad None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:19.317971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5d3ca-ebcb-43f1-9bdf-c44d31221033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:19.318599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5d3ca-ebcb-43f1-9bdf-c44d31221033 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:19.318875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5d3ca-ebcb-43f1-9bdf-c44d31221033 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:19.319180 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5d3ca-ebcb-43f1-9bdf-c44d31221033 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:19.329159 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5d3ca-ebcb-43f1-9bdf-c44d31221033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-4ac5d3ca-ebcb-43f1-9bdf-c44d31221033 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:40:19.333931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:19.335123 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:19.336162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 548/1094] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Oct 3 14:40:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:19.341005 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5d3ca-ebcb-43f1-9bdf-c44d31221033 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:19.341196 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34b707-8031-4b42-822b-cbe1190def73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:19.341809 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34b707-8031-4b42-822b-cbe1190def73 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:19.342092 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34b707-8031-4b42-822b-cbe1190def73 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:19.342368 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34b707-8031-4b42-822b-cbe1190def73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:19.343124 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34b707-8031-4b42-822b-cbe1190def73 None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=f7300d09d45040c6ada3bc8023187270, user.id=9d973273bffb41d3914fdf70d3e6e3e8) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:19.343435 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34b707-8031-4b42-822b-cbe1190def73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:19.344846 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34b707-8031-4b42-822b-cbe1190def73 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:19.355206 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 547/1095] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:40:19 2022] GET /identity/v3/role_assignments?user.id=9d973273bffb41d3914fdf70d3e6e3e8&scope.project.id=f7300d09d45040c6ada3bc8023187270&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:19.447313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5d3ca-ebcb-43f1-9bdf-c44d31221033 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:19.484996 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dbc23-96c8-4871-a5af-f24ee31d121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:19.485622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dbc23-96c8-4871-a5af-f24ee31d121b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:19.485904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dbc23-96c8-4871-a5af-f24ee31d121b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:19.486183 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dbc23-96c8-4871-a5af-f24ee31d121b None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:19.486856 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dbc23-96c8-4871-a5af-f24ee31d121b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:19.487196 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dbc23-96c8-4871-a5af-f24ee31d121b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:19.488581 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dbc23-96c8-4871-a5af-f24ee31d121b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:19.498560 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 549/1096] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Oct 3 14:40:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:40:19.504457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34b707-8031-4b42-822b-cbe1190def73 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:19.553523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:19.611839 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34b707-8031-4b42-822b-cbe1190def73 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:19.644470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880d5e6-2cd7-413f-9700-83aeda590467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:19.645099 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880d5e6-2cd7-413f-9700-83aeda590467 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:19.645380 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880d5e6-2cd7-413f-9700-83aeda590467 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:19.645653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880d5e6-2cd7-413f-9700-83aeda590467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:19.657408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880d5e6-2cd7-413f-9700-83aeda590467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:19.658844 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880d5e6-2cd7-413f-9700-83aeda590467 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-7880d5e6-2cd7-413f-9700-83aeda590467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:40:19.673433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:19.674453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:40:19.675381 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:40:19.675381 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:19.675381 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:19.675381 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 548/1097] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:19.680171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dbc23-96c8-4871-a5af-f24ee31d121b None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:19.720937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:19.780697 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dbc23-96c8-4871-a5af-f24ee31d121b None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:19.815079 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e940a-b9b9-4aa3-ac25-cb7c9812a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:19.815683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e940a-b9b9-4aa3-ac25-cb7c9812a379 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:19.815961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e940a-b9b9-4aa3-ac25-cb7c9812a379 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:19.816230 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e940a-b9b9-4aa3-ac25-cb7c9812a379 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:19.816859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e940a-b9b9-4aa3-ac25-cb7c9812a379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:19.817157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e940a-b9b9-4aa3-ac25-cb7c9812a379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:19.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e940a-b9b9-4aa3-ac25-cb7c9812a379 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:19.830162 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 550/1098] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:19.835764 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880d5e6-2cd7-413f-9700-83aeda590467 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:19.927860 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:19.935790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880d5e6-2cd7-413f-9700-83aeda590467 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:19.968274 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfca548-b470-45fd-a11f-9152bbd46666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:19.968900 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfca548-b470-45fd-a11f-9152bbd46666 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:19.969179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfca548-b470-45fd-a11f-9152bbd46666 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:19.969450 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfca548-b470-45fd-a11f-9152bbd46666 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:19.976645 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfca548-b470-45fd-a11f-9152bbd46666 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:19.978038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfca548-b470-45fd-a11f-9152bbd46666 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-5bfca548-b470-45fd-a11f-9152bbd46666 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:40:19.989470 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:19.990486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:19.991509 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 549/1099] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Oct 3 14:40:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:19.996711 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e940a-b9b9-4aa3-ac25-cb7c9812a379 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:20.099097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:20.103061 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e940a-b9b9-4aa3-ac25-cb7c9812a379 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:20.137465 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf4723-33e3-4f60-8304-fb29ffe7fc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:20.138066 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf4723-33e3-4f60-8304-fb29ffe7fc7a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:20.138349 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf4723-33e3-4f60-8304-fb29ffe7fc7a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:20.138623 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf4723-33e3-4f60-8304-fb29ffe7fc7a None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:20.139374 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf4723-33e3-4f60-8304-fb29ffe7fc7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:20.139685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf4723-33e3-4f60-8304-fb29ffe7fc7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:20.141103 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf4723-33e3-4f60-8304-fb29ffe7fc7a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:20.158526 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 551/1100] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Oct 3 14:40:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:20.164129 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfca548-b470-45fd-a11f-9152bbd46666 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:20.261473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfca548-b470-45fd-a11f-9152bbd46666 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:20.297375 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbf746-a54d-44cb-bd2a-2d018450859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:20.297983 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbf746-a54d-44cb-bd2a-2d018450859c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:20.298266 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbf746-a54d-44cb-bd2a-2d018450859c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:20.298543 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbf746-a54d-44cb-bd2a-2d018450859c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:20.323112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:20.366646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbf746-a54d-44cb-bd2a-2d018450859c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:20.368123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbf746-a54d-44cb-bd2a-2d018450859c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:20.463577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 550/1101] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:20.469281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf4723-33e3-4f60-8304-fb29ffe7fc7a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:20.568124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf4723-33e3-4f60-8304-fb29ffe7fc7a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:20.601490 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e8c74-3185-4fb0-89ad-e35735ea225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:20.602112 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e8c74-3185-4fb0-89ad-e35735ea225c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:20.602404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e8c74-3185-4fb0-89ad-e35735ea225c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:20.602663 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e8c74-3185-4fb0-89ad-e35735ea225c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:20.612358 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e8c74-3185-4fb0-89ad-e35735ea225c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:20.613775 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e8c74-3185-4fb0-89ad-e35735ea225c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-318e8c74-3185-4fb0-89ad-e35735ea225c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:40:20.629030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:20.630221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:40:20.631236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:40:20.631236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:40:20.631236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:20.634740 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 552/1102] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:20.636015 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbf746-a54d-44cb-bd2a-2d018450859c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:20.689464 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:20.733031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbf746-a54d-44cb-bd2a-2d018450859c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:20.766617 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c25dd4-e6c6-4547-81a6-d32776c541cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:20.767314 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25dd4-e6c6-4547-81a6-d32776c541cb None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:20.767598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25dd4-e6c6-4547-81a6-d32776c541cb None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:20.767872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25dd4-e6c6-4547-81a6-d32776c541cb None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:20.768504 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c25dd4-e6c6-4547-81a6-d32776c541cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:20.768805 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c25dd4-e6c6-4547-81a6-d32776c541cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:20.770146 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c25dd4-e6c6-4547-81a6-d32776c541cb None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:20.781172 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 551/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:20.786816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e8c74-3185-4fb0-89ad-e35735ea225c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:20.798258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:20.886857 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e8c74-3185-4fb0-89ad-e35735ea225c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:20.918691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e1e4c-bca5-4723-8ed7-a9769f399680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:20.919333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e1e4c-bca5-4723-8ed7-a9769f399680 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:20.919615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e1e4c-bca5-4723-8ed7-a9769f399680 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:20.919886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e1e4c-bca5-4723-8ed7-a9769f399680 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:20.926184 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e1e4c-bca5-4723-8ed7-a9769f399680 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:20.927624 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e1e4c-bca5-4723-8ed7-a9769f399680 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-d74e1e4c-bca5-4723-8ed7-a9769f399680 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:40:20.938971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:20.940070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:20.941030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:40:20.941030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:40:20.941030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:40:20.941030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:40:20.941030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:40:20.941030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:40:20.941030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:40:20.941030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:20.941030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 553/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:40:20.946070 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c25dd4-e6c6-4547-81a6-d32776c541cb None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:21.046915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c25dd4-e6c6-4547-81a6-d32776c541cb None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:21.065047 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:21.086719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad8579-d2a8-4264-a022-4ccc840a84f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:21.087366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad8579-d2a8-4264-a022-4ccc840a84f5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:21.087650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad8579-d2a8-4264-a022-4ccc840a84f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:21.087925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad8579-d2a8-4264-a022-4ccc840a84f5 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:21.088616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad8579-d2a8-4264-a022-4ccc840a84f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:21.089492 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad8579-d2a8-4264-a022-4ccc840a84f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:21.091105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad8579-d2a8-4264-a022-4ccc840a84f5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:21.108531 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 552/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:21.114635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e1e4c-bca5-4723-8ed7-a9769f399680 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:21.184260 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:21.218544 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e1e4c-bca5-4723-8ed7-a9769f399680 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:21.252615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49d5c-7f09-41ee-b1ae-bdaa50b75537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:21.253216 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49d5c-7f09-41ee-b1ae-bdaa50b75537 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:21.253495 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49d5c-7f09-41ee-b1ae-bdaa50b75537 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:21.253763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49d5c-7f09-41ee-b1ae-bdaa50b75537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:21.254498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49d5c-7f09-41ee-b1ae-bdaa50b75537 None admin] RBAC: Adding query filter params (role.id=3078f35bd776448fae317ac755cbac23, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=bfb0254e89514ff18e1c91dc427e4b1e) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:21.254787 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49d5c-7f09-41ee-b1ae-bdaa50b75537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:21.256246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49d5c-7f09-41ee-b1ae-bdaa50b75537 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:21.262901 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 554/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:40:21 2022] GET /identity/v3/role_assignments?user.id=bfb0254e89514ff18e1c91dc427e4b1e&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=3078f35bd776448fae317ac755cbac23 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:21.575789 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122349ac-b83f-46cc-b991-cfa675328925 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:21.575988 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122349ac-b83f-46cc-b991-cfa675328925 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:21.576263 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122349ac-b83f-46cc-b991-cfa675328925 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:21.577621 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 553/1107] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:21.583222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b678f-371d-47d5-8b18-ad7b66553d8a None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:21.583520 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b678f-371d-47d5-8b18-ad7b66553d8a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:21.583798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b678f-371d-47d5-8b18-ad7b66553d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:21.602621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-654b678f-371d-47d5-8b18-ad7b66553d8a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:21.603826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-654b678f-371d-47d5-8b18-ad7b66553d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:21.672474 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 555/1108] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:21.940568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122349ac-b83f-46cc-b991-cfa675328925 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:22.045493 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122349ac-b83f-46cc-b991-cfa675328925 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:22.079442 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5676b-d240-4723-964d-998a092fe826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:22.080082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5676b-d240-4723-964d-998a092fe826 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:22.080368 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5676b-d240-4723-964d-998a092fe826 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:22.080643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5676b-d240-4723-964d-998a092fe826 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:22.081757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5676b-d240-4723-964d-998a092fe826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:22.083226 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5676b-d240-4723-964d-998a092fe826 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:22.084817 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 554/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:22.091432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b678f-371d-47d5-8b18-ad7b66553d8a None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:22.153770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:22.191395 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b678f-371d-47d5-8b18-ad7b66553d8a None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:22.224607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71defc-cf8e-411b-9bf8-ea32336da7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:22.225206 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71defc-cf8e-411b-9bf8-ea32336da7c0 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:22.225485 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71defc-cf8e-411b-9bf8-ea32336da7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:22.225754 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71defc-cf8e-411b-9bf8-ea32336da7c0 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:22.226404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71defc-cf8e-411b-9bf8-ea32336da7c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:22.227834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71defc-cf8e-411b-9bf8-ea32336da7c0 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:22.248962 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 556/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:40:22 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:40:24.429892 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a082fb-41bb-4abd-ad73-3869193471f8 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:24.430445 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a082fb-41bb-4abd-ad73-3869193471f8 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:24.430445 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a082fb-41bb-4abd-ad73-3869193471f8 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:24.431852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 555/1111] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:24.437046 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8df80e-e29e-48c4-b477-f5e273ecd87a None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:24.437457 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8df80e-e29e-48c4-b477-f5e273ecd87a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:24.437580 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8df80e-e29e-48c4-b477-f5e273ecd87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:24.461130 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-7c8df80e-e29e-48c4-b477-f5e273ecd87a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:24.462322 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-7c8df80e-e29e-48c4-b477-f5e273ecd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:24.534253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 557/1112] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:24.825523 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a082fb-41bb-4abd-ad73-3869193471f8 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:24.872429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:24.944269 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a082fb-41bb-4abd-ad73-3869193471f8 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:24.988776 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99f5b5-ed8c-44c5-82c0-040dd2a6b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:24.989866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99f5b5-ed8c-44c5-82c0-040dd2a6b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:24.990369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99f5b5-ed8c-44c5-82c0-040dd2a6b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:24.990857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99f5b5-ed8c-44c5-82c0-040dd2a6b4a4 None admin] PATH_INFO: `/v3/roles/44e0a79b0d8942bbb803f5a4cb669d6e` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:24.992336 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99f5b5-ed8c-44c5-82c0-040dd2a6b4a4 None admin] RBAC: Authorizing `identity:get_role(role_id=44e0a79b0d8942bbb803f5a4cb669d6e)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:24.993701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99f5b5-ed8c-44c5-82c0-040dd2a6b4a4 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:24.995980 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 556/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:24 2022] GET /identity/v3/roles/44e0a79b0d8942bbb803f5a4cb669d6e => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:25.001686 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8df80e-e29e-48c4-b477-f5e273ecd87a None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:25.053842 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:25.111318 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8df80e-e29e-48c4-b477-f5e273ecd87a None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:25.149934 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92e953-b3d5-4ef2-90bd-d941e3822775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:25.151014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92e953-b3d5-4ef2-90bd-d941e3822775 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:25.151524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92e953-b3d5-4ef2-90bd-d941e3822775 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:25.152027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92e953-b3d5-4ef2-90bd-d941e3822775 None admin] PATH_INFO: `/v3/users/8bc8554355ff4c609c50cc7a136e9c59` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:25.167410 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92e953-b3d5-4ef2-90bd-d941e3822775 None admin] RBAC: Authorizing `identity:get_user(user_id=8bc8554355ff4c609c50cc7a136e9c59)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:25.169033 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92e953-b3d5-4ef2-90bd-d941e3822775 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:25.170698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 558/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:25 2022] GET /identity/v3/users/8bc8554355ff4c609c50cc7a136e9c59 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:25.177118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99f5b5-ed8c-44c5-82c0-040dd2a6b4a4 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:25.293999 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99f5b5-ed8c-44c5-82c0-040dd2a6b4a4 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:25.306243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:25.334315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ca5e1-c0b8-4aff-bcc1-6ec2ada075e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:25.334930 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ca5e1-c0b8-4aff-bcc1-6ec2ada075e2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:25.335242 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ca5e1-c0b8-4aff-bcc1-6ec2ada075e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:25.335521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ca5e1-c0b8-4aff-bcc1-6ec2ada075e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:25.402282 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ca5e1-c0b8-4aff-bcc1-6ec2ada075e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:25.403676 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ca5e1-c0b8-4aff-bcc1-6ec2ada075e2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:25.499182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 557/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:25.505346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92e953-b3d5-4ef2-90bd-d941e3822775 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:25.600777 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92e953-b3d5-4ef2-90bd-d941e3822775 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:25.609033 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:25.634864 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc88815-56a5-49bf-aa8a-e8f2d7eacd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:25.637126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc88815-56a5-49bf-aa8a-e8f2d7eacd14 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:25.637446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc88815-56a5-49bf-aa8a-e8f2d7eacd14 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:25.637718 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc88815-56a5-49bf-aa8a-e8f2d7eacd14 None admin] PATH_INFO: `/v3/projects/f7300d09d45040c6ada3bc8023187270` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:25.638841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc88815-56a5-49bf-aa8a-e8f2d7eacd14 None admin] RBAC: Authorizing `identity:get_project(project_id=f7300d09d45040c6ada3bc8023187270)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:25.640359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc88815-56a5-49bf-aa8a-e8f2d7eacd14 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:25.641961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 559/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:40:25 2022] GET /identity/v3/projects/f7300d09d45040c6ada3bc8023187270 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:25.648061 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ca5e1-c0b8-4aff-bcc1-6ec2ada075e2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:25.660008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:25.742968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ca5e1-c0b8-4aff-bcc1-6ec2ada075e2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:25.775682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf452-a82f-4eda-b9f5-909d284d7170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:25.776886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf452-a82f-4eda-b9f5-909d284d7170 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:25.777167 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf452-a82f-4eda-b9f5-909d284d7170 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:25.777438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf452-a82f-4eda-b9f5-909d284d7170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:25.778143 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbf452-a82f-4eda-b9f5-909d284d7170 None admin] RBAC: Adding query filter params (role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=f7300d09d45040c6ada3bc8023187270, user.id=8bc8554355ff4c609c50cc7a136e9c59) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:25.778446 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbf452-a82f-4eda-b9f5-909d284d7170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:25.779875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbf452-a82f-4eda-b9f5-909d284d7170 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:25.784968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 558/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:40:25 2022] GET /identity/v3/role_assignments?user.id=8bc8554355ff4c609c50cc7a136e9c59&scope.project.id=f7300d09d45040c6ada3bc8023187270&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:27.902079 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e98c99-a1c6-4c7b-938c-74cd16325632 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:27.902614 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e98c99-a1c6-4c7b-938c-74cd16325632 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:27.902614 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e98c99-a1c6-4c7b-938c-74cd16325632 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:27.903979 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 560/1118] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:27.909174 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dac3e-f130-4890-b781-e32a4136a08f None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:27.909562 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dac3e-f130-4890-b781-e32a4136a08f None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:27.909719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dac3e-f130-4890-b781-e32a4136a08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:27.927243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-f40dac3e-f130-4890-b781-e32a4136a08f None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:27.928415 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-f40dac3e-f130-4890-b781-e32a4136a08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:27.993007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 559/1119] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:28.262300 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e98c99-a1c6-4c7b-938c-74cd16325632 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:28.359528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e98c99-a1c6-4c7b-938c-74cd16325632 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:28.392152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd54fc0-891f-4e62-8640-e9e66c9e7da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:28.392767 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd54fc0-891f-4e62-8640-e9e66c9e7da1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:28.393047 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd54fc0-891f-4e62-8640-e9e66c9e7da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:28.393321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd54fc0-891f-4e62-8640-e9e66c9e7da1 None admin] PATH_INFO: `/v3/roles/44e0a79b0d8942bbb803f5a4cb669d6e` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:28.394686 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd54fc0-891f-4e62-8640-e9e66c9e7da1 None admin] RBAC: Authorizing `identity:get_role(role_id=44e0a79b0d8942bbb803f5a4cb669d6e)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:28.396065 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd54fc0-891f-4e62-8640-e9e66c9e7da1 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:28.397356 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 561/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:28 2022] GET /identity/v3/roles/44e0a79b0d8942bbb803f5a4cb669d6e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:28.403776 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dac3e-f130-4890-b781-e32a4136a08f None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:28.406803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:28.497845 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dac3e-f130-4890-b781-e32a4136a08f None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:28.531019 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67048eca-00ce-4322-b7ea-ffac11492b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:28.531580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67048eca-00ce-4322-b7ea-ffac11492b3f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:28.531862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67048eca-00ce-4322-b7ea-ffac11492b3f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:28.532134 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67048eca-00ce-4322-b7ea-ffac11492b3f None admin] PATH_INFO: `/v3/users/8bc8554355ff4c609c50cc7a136e9c59` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:28.533230 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67048eca-00ce-4322-b7ea-ffac11492b3f None admin] RBAC: Authorizing `identity:get_user(user_id=8bc8554355ff4c609c50cc7a136e9c59)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:28.534639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67048eca-00ce-4322-b7ea-ffac11492b3f None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:28.536224 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 560/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:28 2022] GET /identity/v3/users/8bc8554355ff4c609c50cc7a136e9c59 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:28.542257 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd54fc0-891f-4e62-8640-e9e66c9e7da1 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:28.584776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:28.645741 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd54fc0-891f-4e62-8640-e9e66c9e7da1 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:28.677885 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93c049-a62a-4e85-9ea2-2e3781f71829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:28.678496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c049-a62a-4e85-9ea2-2e3781f71829 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:28.678772 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c049-a62a-4e85-9ea2-2e3781f71829 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:28.679070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93c049-a62a-4e85-9ea2-2e3781f71829 None admin] PATH_INFO: `/v3/projects/f7300d09d45040c6ada3bc8023187270` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:28.680156 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93c049-a62a-4e85-9ea2-2e3781f71829 None admin] RBAC: Authorizing `identity:get_project(project_id=f7300d09d45040c6ada3bc8023187270)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:28.681550 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93c049-a62a-4e85-9ea2-2e3781f71829 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:28.684255 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 562/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:40:28 2022] GET /identity/v3/projects/f7300d09d45040c6ada3bc8023187270 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:28.690283 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67048eca-00ce-4322-b7ea-ffac11492b3f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:28.757708 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:28.786722 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67048eca-00ce-4322-b7ea-ffac11492b3f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:28.818882 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba173a-2b2a-49ba-96f3-86838b836a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:28.819553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba173a-2b2a-49ba-96f3-86838b836a73 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:28.819834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba173a-2b2a-49ba-96f3-86838b836a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:28.820108 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba173a-2b2a-49ba-96f3-86838b836a73 None admin] PATH_INFO: `/v3/projects/f7300d09d45040c6ada3bc8023187270/users/8bc8554355ff4c609c50cc7a136e9c59/roles/44e0a79b0d8942bbb803f5a4cb669d6e` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:28.822197 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba173a-2b2a-49ba-96f3-86838b836a73 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7300d09d45040c6ada3bc8023187270, user_id=8bc8554355ff4c609c50cc7a136e9c59, role_id=44e0a79b0d8942bbb803f5a4cb669d6e)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:28.824400 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba173a-2b2a-49ba-96f3-86838b836a73 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:28.836594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 561/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:40:28 2022] PUT /identity/v3/projects/f7300d09d45040c6ada3bc8023187270/users/8bc8554355ff4c609c50cc7a136e9c59/roles/44e0a79b0d8942bbb803f5a4cb669d6e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:40:30.983379 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43c39-6aa6-43b5-9b30-3e3700e0c6f0 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:30.983911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43c39-6aa6-43b5-9b30-3e3700e0c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:30.983911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b43c39-6aa6-43b5-9b30-3e3700e0c6f0 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:30.985263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 563/1124] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:30.990519 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcc332-ea59-45bc-85d5-e7c630919f17 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:30.990963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcc332-ea59-45bc-85d5-e7c630919f17 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:30.991107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcc332-ea59-45bc-85d5-e7c630919f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:31.009647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-b0dcc332-ea59-45bc-85d5-e7c630919f17 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:31.011782 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-b0dcc332-ea59-45bc-85d5-e7c630919f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:31.076392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 562/1125] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:31.351332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b43c39-6aa6-43b5-9b30-3e3700e0c6f0 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:31.450060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b43c39-6aa6-43b5-9b30-3e3700e0c6f0 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:31.460244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:31.483514 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82195272-5b9b-4647-b185-0daf12b64e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:31.484131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82195272-5b9b-4647-b185-0daf12b64e0f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:31.484413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82195272-5b9b-4647-b185-0daf12b64e0f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:31.484687 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82195272-5b9b-4647-b185-0daf12b64e0f None admin] PATH_INFO: `/v3/roles/44e0a79b0d8942bbb803f5a4cb669d6e` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:31.486053 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82195272-5b9b-4647-b185-0daf12b64e0f None admin] RBAC: Authorizing `identity:get_role(role_id=44e0a79b0d8942bbb803f5a4cb669d6e)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:31.487438 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82195272-5b9b-4647-b185-0daf12b64e0f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:31.488735 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 564/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:31 2022] GET /identity/v3/roles/44e0a79b0d8942bbb803f5a4cb669d6e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:31.494428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcc332-ea59-45bc-85d5-e7c630919f17 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:31.559051 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:31.598823 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcc332-ea59-45bc-85d5-e7c630919f17 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:31.632133 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47edcc-cbec-4ae7-ad74-279f5d32396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:31.632702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47edcc-cbec-4ae7-ad74-279f5d32396c None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:31.632985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47edcc-cbec-4ae7-ad74-279f5d32396c None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:31.633264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47edcc-cbec-4ae7-ad74-279f5d32396c None admin] PATH_INFO: `/v3/users/8bc8554355ff4c609c50cc7a136e9c59` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:31.634374 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47edcc-cbec-4ae7-ad74-279f5d32396c None admin] RBAC: Authorizing `identity:get_user(user_id=8bc8554355ff4c609c50cc7a136e9c59)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:31.635972 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47edcc-cbec-4ae7-ad74-279f5d32396c None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:31.637542 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 563/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:31 2022] GET /identity/v3/users/8bc8554355ff4c609c50cc7a136e9c59 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:31.643289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82195272-5b9b-4647-b185-0daf12b64e0f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:31.749758 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82195272-5b9b-4647-b185-0daf12b64e0f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:31.782371 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae36a55-8e60-4002-9d14-e1af2fd3501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:31.782994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36a55-8e60-4002-9d14-e1af2fd3501d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:31.783282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36a55-8e60-4002-9d14-e1af2fd3501d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:31.783558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae36a55-8e60-4002-9d14-e1af2fd3501d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:31.827185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:31.849019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae36a55-8e60-4002-9d14-e1af2fd3501d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:31.850443 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae36a55-8e60-4002-9d14-e1af2fd3501d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:31.946755 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 565/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:31.953372 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47edcc-cbec-4ae7-ad74-279f5d32396c None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:32.048661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47edcc-cbec-4ae7-ad74-279f5d32396c None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:32.075170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:32.080950 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046b48f-634c-46a8-93da-5ffc5d646cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:32.081565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046b48f-634c-46a8-93da-5ffc5d646cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:32.081842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046b48f-634c-46a8-93da-5ffc5d646cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:32.082112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046b48f-634c-46a8-93da-5ffc5d646cc0 None admin] PATH_INFO: `/v3/projects/f7300d09d45040c6ada3bc8023187270` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:32.083231 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046b48f-634c-46a8-93da-5ffc5d646cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=f7300d09d45040c6ada3bc8023187270)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:32.084647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046b48f-634c-46a8-93da-5ffc5d646cc0 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:32.086259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 564/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:40:31 2022] GET /identity/v3/projects/f7300d09d45040c6ada3bc8023187270 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:32.093270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae36a55-8e60-4002-9d14-e1af2fd3501d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:32.167175 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:32.187274 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae36a55-8e60-4002-9d14-e1af2fd3501d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:32.219392 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abfd89-24bc-41e2-98b3-d6bb621a61ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:32.219917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abfd89-24bc-41e2-98b3-d6bb621a61ec None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:32.220193 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abfd89-24bc-41e2-98b3-d6bb621a61ec None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:32.220463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abfd89-24bc-41e2-98b3-d6bb621a61ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:32.221163 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abfd89-24bc-41e2-98b3-d6bb621a61ec None admin] RBAC: Adding query filter params (role.id=44e0a79b0d8942bbb803f5a4cb669d6e, scope.project.id=f7300d09d45040c6ada3bc8023187270, user.id=8bc8554355ff4c609c50cc7a136e9c59) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:32.221467 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abfd89-24bc-41e2-98b3-d6bb621a61ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:32.222855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abfd89-24bc-41e2-98b3-d6bb621a61ec None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:32.228360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 566/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:40:32 2022] GET /identity/v3/role_assignments?user.id=8bc8554355ff4c609c50cc7a136e9c59&scope.project.id=f7300d09d45040c6ada3bc8023187270&role.id=44e0a79b0d8942bbb803f5a4cb669d6e => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:34.394633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cc5d1-fd2a-4262-95d1-e6f5c963f7a4 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:34.395225 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cc5d1-fd2a-4262-95d1-e6f5c963f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:34.395225 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cc5d1-fd2a-4262-95d1-e6f5c963f7a4 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:34.396460 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 565/1131] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:34.401728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01361c-14ec-41bf-aec2-cd9cec44d29b None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:34.402101 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01361c-14ec-41bf-aec2-cd9cec44d29b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:34.402282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01361c-14ec-41bf-aec2-cd9cec44d29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:34.420520 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-5c01361c-14ec-41bf-aec2-cd9cec44d29b None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:34.421698 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-5c01361c-14ec-41bf-aec2-cd9cec44d29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:34.485297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 567/1132] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:34.757040 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cc5d1-fd2a-4262-95d1-e6f5c963f7a4 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:34.861895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cc5d1-fd2a-4262-95d1-e6f5c963f7a4 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:34.901716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56385c-6b2e-4200-a49c-77fd16fa7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:34.902343 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56385c-6b2e-4200-a49c-77fd16fa7b59 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:34.902625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56385c-6b2e-4200-a49c-77fd16fa7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:34.902895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56385c-6b2e-4200-a49c-77fd16fa7b59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:34.904014 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56385c-6b2e-4200-a49c-77fd16fa7b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:34.905422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56385c-6b2e-4200-a49c-77fd16fa7b59 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:34.907000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 566/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:34.912773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01361c-14ec-41bf-aec2-cd9cec44d29b None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:34.978316 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:35.007891 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01361c-14ec-41bf-aec2-cd9cec44d29b None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:35.040327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572aa50-03a3-4e36-9354-2562849047bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:35.040929 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572aa50-03a3-4e36-9354-2562849047bd None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:35.041195 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572aa50-03a3-4e36-9354-2562849047bd None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:35.041531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572aa50-03a3-4e36-9354-2562849047bd None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:35.042259 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572aa50-03a3-4e36-9354-2562849047bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:35.043682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572aa50-03a3-4e36-9354-2562849047bd None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:35.068395 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 568/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:40:34 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:40:37.218156 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea0386-09b3-449c-8415-cef8e9886028 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:37.218709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea0386-09b3-449c-8415-cef8e9886028 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:37.218709 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea0386-09b3-449c-8415-cef8e9886028 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:37.220056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 567/1135] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:37.225433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782c2dd-0413-4033-9326-fa462db5d769 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:37.225828 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782c2dd-0413-4033-9326-fa462db5d769 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:37.225988 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782c2dd-0413-4033-9326-fa462db5d769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:37.246140 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-8782c2dd-0413-4033-9326-fa462db5d769 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:37.247355 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-8782c2dd-0413-4033-9326-fa462db5d769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:37.313089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 569/1136] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:37.576903 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea0386-09b3-449c-8415-cef8e9886028 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:37.641055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:37.676932 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea0386-09b3-449c-8415-cef8e9886028 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:37.708975 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995d618-ade2-4fa7-ba82-71c14be98219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:37.709602 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995d618-ade2-4fa7-ba82-71c14be98219 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:37.709885 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995d618-ade2-4fa7-ba82-71c14be98219 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:37.710163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995d618-ade2-4fa7-ba82-71c14be98219 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:37.711286 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995d618-ade2-4fa7-ba82-71c14be98219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:37.712701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995d618-ade2-4fa7-ba82-71c14be98219 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:37.714886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 568/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:37.720561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782c2dd-0413-4033-9326-fa462db5d769 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:37.772323 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:37.815186 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782c2dd-0413-4033-9326-fa462db5d769 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:37.847484 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cf8e0-ea26-48fc-b2fc-ac6275374738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:37.848080 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cf8e0-ea26-48fc-b2fc-ac6275374738 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:37.848356 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cf8e0-ea26-48fc-b2fc-ac6275374738 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:37.848625 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cf8e0-ea26-48fc-b2fc-ac6275374738 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:37.849256 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cf8e0-ea26-48fc-b2fc-ac6275374738 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:37.850648 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cf8e0-ea26-48fc-b2fc-ac6275374738 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:37.871373 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 570/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:40:37 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:40:40.045943 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f1bc5-6737-4817-80aa-0b538b6686aa None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:40.046466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f1bc5-6737-4817-80aa-0b538b6686aa None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:40.046466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f1bc5-6737-4817-80aa-0b538b6686aa None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:40.047858 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 569/1139] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:40.053286 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2fa76-16ea-44dc-8c36-5b3a2d1939a9 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:40.053712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2fa76-16ea-44dc-8c36-5b3a2d1939a9 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:40.053843 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2fa76-16ea-44dc-8c36-5b3a2d1939a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:40.074294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-a0b2fa76-16ea-44dc-8c36-5b3a2d1939a9 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:40.075480 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-a0b2fa76-16ea-44dc-8c36-5b3a2d1939a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:40.140099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 571/1140] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:40.404699 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f1bc5-6737-4817-80aa-0b538b6686aa None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:40.504086 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f1bc5-6737-4817-80aa-0b538b6686aa None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:40.535538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbccc4-211a-4e27-92c8-20272a52e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:40.536151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbccc4-211a-4e27-92c8-20272a52e43f None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:40.536428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbccc4-211a-4e27-92c8-20272a52e43f None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:40.536698 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbccc4-211a-4e27-92c8-20272a52e43f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:40.538404 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:40.547697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbccc4-211a-4e27-92c8-20272a52e43f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-6fcbccc4-211a-4e27-92c8-20272a52e43f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:40:40.552429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:40.553545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:40.554585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 570/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:40.560224 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2fa76-16ea-44dc-8c36-5b3a2d1939a9 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:40.600155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:40.656343 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2fa76-16ea-44dc-8c36-5b3a2d1939a9 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:40.688735 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9759776-0883-4734-8515-05eb6741df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:40.689331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9759776-0883-4734-8515-05eb6741df37 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:40.689609 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9759776-0883-4734-8515-05eb6741df37 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:40.689879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9759776-0883-4734-8515-05eb6741df37 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:40.690524 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9759776-0883-4734-8515-05eb6741df37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:40.690823 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9759776-0883-4734-8515-05eb6741df37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:40.692197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9759776-0883-4734-8515-05eb6741df37 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:40.700178 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 572/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:40.706004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbccc4-211a-4e27-92c8-20272a52e43f None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:40.804508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbccc4-211a-4e27-92c8-20272a52e43f None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:40.836314 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7bb00-d08e-4dcb-b13d-64519d3b4cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:40.836925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7bb00-d08e-4dcb-b13d-64519d3b4cab None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:40.837205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7bb00-d08e-4dcb-b13d-64519d3b4cab None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:40.837476 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7bb00-d08e-4dcb-b13d-64519d3b4cab None admin] PATH_INFO: `/v3/users/8bf01e877c1040d787e10ac6a64930ac` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:40.850345 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7bb00-d08e-4dcb-b13d-64519d3b4cab None admin] RBAC: Authorizing `identity:get_user(user_id=8bf01e877c1040d787e10ac6a64930ac)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:40.851784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7bb00-d08e-4dcb-b13d-64519d3b4cab None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:40.853348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 571/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:40 2022] GET /identity/v3/users/8bf01e877c1040d787e10ac6a64930ac => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:40.859644 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9759776-0883-4734-8515-05eb6741df37 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:40.957501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9759776-0883-4734-8515-05eb6741df37 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:40.958912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:40.991561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cf7d6-04b3-4dcc-a00b-6bfbe0b6cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:40.992161 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cf7d6-04b3-4dcc-a00b-6bfbe0b6cf5e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:40.992441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cf7d6-04b3-4dcc-a00b-6bfbe0b6cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:40.992715 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cf7d6-04b3-4dcc-a00b-6bfbe0b6cf5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:41.059595 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cf7d6-04b3-4dcc-a00b-6bfbe0b6cf5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:41.061028 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cf7d6-04b3-4dcc-a00b-6bfbe0b6cf5e None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:41.159275 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 573/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:41.165154 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7bb00-d08e-4dcb-b13d-64519d3b4cab None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:41.217704 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:41.262805 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7bb00-d08e-4dcb-b13d-64519d3b4cab None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:41.295075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48fc81-925a-40bc-8099-23e3886c0809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:41.295691 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48fc81-925a-40bc-8099-23e3886c0809 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:41.295967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48fc81-925a-40bc-8099-23e3886c0809 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:41.296235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48fc81-925a-40bc-8099-23e3886c0809 None admin] PATH_INFO: `/v3/projects/05fbc0f5e886463d84d6a73a06dd2583` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:41.297307 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48fc81-925a-40bc-8099-23e3886c0809 None admin] RBAC: Authorizing `identity:get_project(project_id=05fbc0f5e886463d84d6a73a06dd2583)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:41.298693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48fc81-925a-40bc-8099-23e3886c0809 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:41.300322 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 572/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:40:41 2022] GET /identity/v3/projects/05fbc0f5e886463d84d6a73a06dd2583 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:41.306456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cf7d6-04b3-4dcc-a00b-6bfbe0b6cf5e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:41.309456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:41.405558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cf7d6-04b3-4dcc-a00b-6bfbe0b6cf5e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:41.438613 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16405b15-93db-4d9b-8ca6-fd8ebe8a8daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:41.439235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16405b15-93db-4d9b-8ca6-fd8ebe8a8daf None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:41.439516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16405b15-93db-4d9b-8ca6-fd8ebe8a8daf None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:41.439790 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16405b15-93db-4d9b-8ca6-fd8ebe8a8daf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:41.440499 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16405b15-93db-4d9b-8ca6-fd8ebe8a8daf None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=05fbc0f5e886463d84d6a73a06dd2583, user.id=8bf01e877c1040d787e10ac6a64930ac) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:41.440807 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16405b15-93db-4d9b-8ca6-fd8ebe8a8daf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:41.442216 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16405b15-93db-4d9b-8ca6-fd8ebe8a8daf None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:41.447466 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 574/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:40:41 2022] GET /identity/v3/role_assignments?user.id=8bf01e877c1040d787e10ac6a64930ac&scope.project.id=05fbc0f5e886463d84d6a73a06dd2583&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:43.585305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444511d-aea9-4d02-bcea-14b432aac547 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:43.585809 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444511d-aea9-4d02-bcea-14b432aac547 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:43.585933 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444511d-aea9-4d02-bcea-14b432aac547 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:43.587216 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 573/1147] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:43.592388 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42ad92-1c69-402d-8cc2-40fc9aaae0a9 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:43.592801 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42ad92-1c69-402d-8cc2-40fc9aaae0a9 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:43.592932 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42ad92-1c69-402d-8cc2-40fc9aaae0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:43.610403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-5c42ad92-1c69-402d-8cc2-40fc9aaae0a9 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:43.611599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-5c42ad92-1c69-402d-8cc2-40fc9aaae0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:43.669089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:43.676336 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 575/1148] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:43.943010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444511d-aea9-4d02-bcea-14b432aac547 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:44.042486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444511d-aea9-4d02-bcea-14b432aac547 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:44.061752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:44.076004 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c33d0-3bc6-4d35-b65e-71a091f135d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:44.076627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c33d0-3bc6-4d35-b65e-71a091f135d6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:44.076907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c33d0-3bc6-4d35-b65e-71a091f135d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:44.077184 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c33d0-3bc6-4d35-b65e-71a091f135d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:44.090559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c33d0-3bc6-4d35-b65e-71a091f135d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-898c33d0-3bc6-4d35-b65e-71a091f135d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:40:44.095392 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:44.096540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:44.097426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 574/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:44.102390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42ad92-1c69-402d-8cc2-40fc9aaae0a9 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:44.197779 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42ad92-1c69-402d-8cc2-40fc9aaae0a9 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:44.231060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbcf56-5b34-4f96-aad5-5eeff9f11d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:44.231656 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbcf56-5b34-4f96-aad5-5eeff9f11d8f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:44.231936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbcf56-5b34-4f96-aad5-5eeff9f11d8f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:44.232209 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbcf56-5b34-4f96-aad5-5eeff9f11d8f None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:44.232853 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbcf56-5b34-4f96-aad5-5eeff9f11d8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:44.233153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbcf56-5b34-4f96-aad5-5eeff9f11d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:44.234496 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbcf56-5b34-4f96-aad5-5eeff9f11d8f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:44.242176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 576/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:44.248527 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c33d0-3bc6-4d35-b65e-71a091f135d6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:44.346540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c33d0-3bc6-4d35-b65e-71a091f135d6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:44.379756 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c96033-5a5f-4c88-8faa-851902ba53ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:44.380367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96033-5a5f-4c88-8faa-851902ba53ca None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:44.380650 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96033-5a5f-4c88-8faa-851902ba53ca None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:44.380926 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c96033-5a5f-4c88-8faa-851902ba53ca None admin] PATH_INFO: `/v3/users/8bf01e877c1040d787e10ac6a64930ac` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:44.382007 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c96033-5a5f-4c88-8faa-851902ba53ca None admin] RBAC: Authorizing `identity:get_user(user_id=8bf01e877c1040d787e10ac6a64930ac)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:44.383456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c96033-5a5f-4c88-8faa-851902ba53ca None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:44.385774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 575/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:44 2022] GET /identity/v3/users/8bf01e877c1040d787e10ac6a64930ac => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:44.391399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbcf56-5b34-4f96-aad5-5eeff9f11d8f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:44.446643 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:44.487100 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbcf56-5b34-4f96-aad5-5eeff9f11d8f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:44.519694 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fb2ac-5317-41dd-ba69-05607c9f6581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:44.520307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fb2ac-5317-41dd-ba69-05607c9f6581 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:44.520585 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fb2ac-5317-41dd-ba69-05607c9f6581 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:44.520856 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fb2ac-5317-41dd-ba69-05607c9f6581 None admin] PATH_INFO: `/v3/projects/05fbc0f5e886463d84d6a73a06dd2583` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:44.521940 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fb2ac-5317-41dd-ba69-05607c9f6581 None admin] RBAC: Authorizing `identity:get_project(project_id=05fbc0f5e886463d84d6a73a06dd2583)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:44.523378 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fb2ac-5317-41dd-ba69-05607c9f6581 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:44.524978 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 577/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:40:44 2022] GET /identity/v3/projects/05fbc0f5e886463d84d6a73a06dd2583 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:44.530795 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c96033-5a5f-4c88-8faa-851902ba53ca None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:44.577589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:44.625909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c96033-5a5f-4c88-8faa-851902ba53ca None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:44.657656 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79424caa-4b1c-4414-aa60-2fa99442aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:44.658289 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79424caa-4b1c-4414-aa60-2fa99442aa45 None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:44.658568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79424caa-4b1c-4414-aa60-2fa99442aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:44.658842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79424caa-4b1c-4414-aa60-2fa99442aa45 None admin] PATH_INFO: `/v3/projects/05fbc0f5e886463d84d6a73a06dd2583/users/8bf01e877c1040d787e10ac6a64930ac/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:44.660705 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79424caa-4b1c-4414-aa60-2fa99442aa45 None admin] RBAC: Authorizing `identity:create_grant(project_id=05fbc0f5e886463d84d6a73a06dd2583, user_id=8bf01e877c1040d787e10ac6a64930ac, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:44.662107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79424caa-4b1c-4414-aa60-2fa99442aa45 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:44.675759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 576/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:40:44 2022] PUT /identity/v3/projects/05fbc0f5e886463d84d6a73a06dd2583/users/8bf01e877c1040d787e10ac6a64930ac/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:40:46.797786 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9450a5-def9-4f30-89f8-7d3e050e06d3 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:46.798319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9450a5-def9-4f30-89f8-7d3e050e06d3 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:46.798319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9450a5-def9-4f30-89f8-7d3e050e06d3 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:46.799712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 578/1154] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:46.804810 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b638-015e-44ae-bcda-24979aa531c0 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:46.805229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b638-015e-44ae-bcda-24979aa531c0 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:46.805357 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b638-015e-44ae-bcda-24979aa531c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:46.822899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-9900b638-015e-44ae-bcda-24979aa531c0 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:46.824086 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-9900b638-015e-44ae-bcda-24979aa531c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:46.890641 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 577/1155] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:47.161922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9450a5-def9-4f30-89f8-7d3e050e06d3 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:47.263404 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9450a5-def9-4f30-89f8-7d3e050e06d3 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:47.288083 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:47.296585 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be0e81-ced9-4281-97e7-a2b8a39bfee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:47.297199 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be0e81-ced9-4281-97e7-a2b8a39bfee3 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:47.297475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be0e81-ced9-4281-97e7-a2b8a39bfee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:47.297744 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be0e81-ced9-4281-97e7-a2b8a39bfee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:47.307973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be0e81-ced9-4281-97e7-a2b8a39bfee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-54be0e81-ced9-4281-97e7-a2b8a39bfee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:40:47.312690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:47.313890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:40:47.315022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 579/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:47.319838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b638-015e-44ae-bcda-24979aa531c0 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:47.359284 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:47.419379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b638-015e-44ae-bcda-24979aa531c0 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:47.453955 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf32f94-f09a-4c9d-89b7-73ac6a6ead13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:47.454551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf32f94-f09a-4c9d-89b7-73ac6a6ead13 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:47.454832 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf32f94-f09a-4c9d-89b7-73ac6a6ead13 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:47.455136 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf32f94-f09a-4c9d-89b7-73ac6a6ead13 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:47.455792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf32f94-f09a-4c9d-89b7-73ac6a6ead13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:47.456100 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf32f94-f09a-4c9d-89b7-73ac6a6ead13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:47.457442 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf32f94-f09a-4c9d-89b7-73ac6a6ead13 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:47.465548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 578/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:47.471449 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be0e81-ced9-4281-97e7-a2b8a39bfee3 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:47.570134 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be0e81-ced9-4281-97e7-a2b8a39bfee3 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:47.603832 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4e127-7a12-42a0-a8a4-9c851b729e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:47.604454 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4e127-7a12-42a0-a8a4-9c851b729e58 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:47.604737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4e127-7a12-42a0-a8a4-9c851b729e58 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:47.605016 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4e127-7a12-42a0-a8a4-9c851b729e58 None admin] PATH_INFO: `/v3/users/8bf01e877c1040d787e10ac6a64930ac` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:47.606122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4e127-7a12-42a0-a8a4-9c851b729e58 None admin] RBAC: Authorizing `identity:get_user(user_id=8bf01e877c1040d787e10ac6a64930ac)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:47.607581 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4e127-7a12-42a0-a8a4-9c851b729e58 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:47.609143 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 580/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:40:47 2022] GET /identity/v3/users/8bf01e877c1040d787e10ac6a64930ac => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:47.615010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf32f94-f09a-4c9d-89b7-73ac6a6ead13 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:47.709869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:47.712888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf32f94-f09a-4c9d-89b7-73ac6a6ead13 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:47.746909 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eac24b-c60e-454f-9aba-e910ebd855ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:47.747536 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eac24b-c60e-454f-9aba-e910ebd855ca None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:47.747820 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eac24b-c60e-454f-9aba-e910ebd855ca None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:47.748096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eac24b-c60e-454f-9aba-e910ebd855ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:47.812701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eac24b-c60e-454f-9aba-e910ebd855ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:47.814217 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eac24b-c60e-454f-9aba-e910ebd855ca None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:47.904696 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:47.908605 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 579/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:47.914359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4e127-7a12-42a0-a8a4-9c851b729e58 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:47.967860 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:48.012488 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4e127-7a12-42a0-a8a4-9c851b729e58 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:48.044362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9b455-d858-4d8c-8a41-f5477915b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:48.044971 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9b455-d858-4d8c-8a41-f5477915b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:48.045246 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9b455-d858-4d8c-8a41-f5477915b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:48.045515 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9b455-d858-4d8c-8a41-f5477915b6e1 None admin] PATH_INFO: `/v3/projects/05fbc0f5e886463d84d6a73a06dd2583` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:48.046585 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9b455-d858-4d8c-8a41-f5477915b6e1 None admin] RBAC: Authorizing `identity:get_project(project_id=05fbc0f5e886463d84d6a73a06dd2583)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:48.048012 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9b455-d858-4d8c-8a41-f5477915b6e1 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:48.049594 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 581/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:40:47 2022] GET /identity/v3/projects/05fbc0f5e886463d84d6a73a06dd2583 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:48.055742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eac24b-c60e-454f-9aba-e910ebd855ca None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:48.152403 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eac24b-c60e-454f-9aba-e910ebd855ca None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:48.185432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862f523-1f12-411e-918d-b8444e5dd85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:48.185977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862f523-1f12-411e-918d-b8444e5dd85a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:48.186260 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862f523-1f12-411e-918d-b8444e5dd85a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:48.186538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862f523-1f12-411e-918d-b8444e5dd85a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:48.187282 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862f523-1f12-411e-918d-b8444e5dd85a None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=05fbc0f5e886463d84d6a73a06dd2583, user.id=8bf01e877c1040d787e10ac6a64930ac) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:48.187596 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862f523-1f12-411e-918d-b8444e5dd85a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:48.189012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862f523-1f12-411e-918d-b8444e5dd85a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:48.194597 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 580/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:40:48 2022] GET /identity/v3/role_assignments?user.id=8bf01e877c1040d787e10ac6a64930ac&scope.project.id=05fbc0f5e886463d84d6a73a06dd2583&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:50.329263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d23068-3780-40c7-a3c1-f36c4e2b58f9 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:50.329821 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d23068-3780-40c7-a3c1-f36c4e2b58f9 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:50.329821 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d23068-3780-40c7-a3c1-f36c4e2b58f9 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:50.331158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 582/1162] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:50.336293 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3da59f-f3c8-4952-92ee-929ec557c956 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:50.336737 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3da59f-f3c8-4952-92ee-929ec557c956 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:50.336844 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3da59f-f3c8-4952-92ee-929ec557c956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:50.355895 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-7b3da59f-f3c8-4952-92ee-929ec557c956 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:50.357018 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-7b3da59f-f3c8-4952-92ee-929ec557c956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:50.413115 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:50.422969 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 581/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 14:40:50.692808 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d23068-3780-40c7-a3c1-f36c4e2b58f9 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:50.791122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d23068-3780-40c7-a3c1-f36c4e2b58f9 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:50.812142 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:50.823800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08721d-6141-433c-9d04-3898ea187810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:50.824388 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08721d-6141-433c-9d04-3898ea187810 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:50.824664 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08721d-6141-433c-9d04-3898ea187810 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:50.824931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08721d-6141-433c-9d04-3898ea187810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:50.890099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08721d-6141-433c-9d04-3898ea187810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:50.891565 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08721d-6141-433c-9d04-3898ea187810 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:50.986216 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 583/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:40:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:40:50.992171 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3da59f-f3c8-4952-92ee-929ec557c956 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:51.088580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3da59f-f3c8-4952-92ee-929ec557c956 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:51.121688 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf3dee-64b8-4efc-91f4-b75202e17f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:51.122311 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf3dee-64b8-4efc-91f4-b75202e17f44 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:51.122589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf3dee-64b8-4efc-91f4-b75202e17f44 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:51.122859 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf3dee-64b8-4efc-91f4-b75202e17f44 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:51.129236 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf3dee-64b8-4efc-91f4-b75202e17f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:51.130638 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf3dee-64b8-4efc-91f4-b75202e17f44 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-fecf3dee-64b8-4efc-91f4-b75202e17f44 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:40:51.143093 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:40:51.144438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:40:51.145620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 582/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:40:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:40:51.150089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08721d-6141-433c-9d04-3898ea187810 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:51.172833 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:51.246284 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08721d-6141-433c-9d04-3898ea187810 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:51.278874 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6a846-f09f-4a47-aa86-69c06b0d81b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:51.281152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a846-f09f-4a47-aa86-69c06b0d81b5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:51.281152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a846-f09f-4a47-aa86-69c06b0d81b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:51.281152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a846-f09f-4a47-aa86-69c06b0d81b5 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:51.281152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6a846-f09f-4a47-aa86-69c06b0d81b5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:40:51.281152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6a846-f09f-4a47-aa86-69c06b0d81b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:51.282274 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6a846-f09f-4a47-aa86-69c06b0d81b5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:51.289922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 584/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Oct 3 14:40:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:53.402907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cbd9e-b368-4f65-9a9a-39ae2a9f3dfc None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:53.403464 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cbd9e-b368-4f65-9a9a-39ae2a9f3dfc None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:53.403464 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cbd9e-b368-4f65-9a9a-39ae2a9f3dfc None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:53.404757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 583/1167] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:53.409975 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22037dba-3e72-4bab-bf7e-94a3c9884fa6 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:53.410416 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22037dba-3e72-4bab-bf7e-94a3c9884fa6 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:53.410513 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22037dba-3e72-4bab-bf7e-94a3c9884fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:53.429219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-22037dba-3e72-4bab-bf7e-94a3c9884fa6 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:53.430402 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-22037dba-3e72-4bab-bf7e-94a3c9884fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:53.495209 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 585/1168] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:53.758351 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cbd9e-b368-4f65-9a9a-39ae2a9f3dfc None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:53.812991 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:53.857773 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cbd9e-b368-4f65-9a9a-39ae2a9f3dfc None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:53.890275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ceafb-a75c-4419-bf82-e050dfc0ff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:53.890872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ceafb-a75c-4419-bf82-e050dfc0ff2b None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:53.891181 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ceafb-a75c-4419-bf82-e050dfc0ff2b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:53.891464 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ceafb-a75c-4419-bf82-e050dfc0ff2b None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:53.892125 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ceafb-a75c-4419-bf82-e050dfc0ff2b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:53.893466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ceafb-a75c-4419-bf82-e050dfc0ff2b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:53.909026 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 584/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Mon Oct 3 14:40:53 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:40:56.062784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d550cf-5393-4937-8bb6-b440bf3272c0 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:56.063440 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d550cf-5393-4937-8bb6-b440bf3272c0 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:56.063440 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d550cf-5393-4937-8bb6-b440bf3272c0 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:56.064701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 586/1170] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:56.069913 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d85969-7975-4b25-8900-c121a0febd5f None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:56.070325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d85969-7975-4b25-8900-c121a0febd5f None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:56.070466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d85969-7975-4b25-8900-c121a0febd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:56.089677 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-48d85969-7975-4b25-8900-c121a0febd5f None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:56.090905 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-48d85969-7975-4b25-8900-c121a0febd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:56.156379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 585/1171] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:56.426194 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d550cf-5393-4937-8bb6-b440bf3272c0 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:56.445005 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:56.528159 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d550cf-5393-4937-8bb6-b440bf3272c0 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:56.561406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a130a-c5b0-4fc6-88ce-c6fe8f5e704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:56.562018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a130a-c5b0-4fc6-88ce-c6fe8f5e704c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:56.562297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a130a-c5b0-4fc6-88ce-c6fe8f5e704c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:56.562570 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a130a-c5b0-4fc6-88ce-c6fe8f5e704c None admin] PATH_INFO: `/v3/domains/96dac9d5bed249658d01074f99012436` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:56.572613 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a130a-c5b0-4fc6-88ce-c6fe8f5e704c None admin] RBAC: Authorizing `identity:get_domain(domain_id=96dac9d5bed249658d01074f99012436)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:56.574020 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a130a-c5b0-4fc6-88ce-c6fe8f5e704c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:56.575604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 587/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Oct 3 14:40:56 2022] GET /identity/v3/domains/96dac9d5bed249658d01074f99012436 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:56.581440 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d85969-7975-4b25-8900-c121a0febd5f None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:56.626055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:56.682422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d85969-7975-4b25-8900-c121a0febd5f None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:56.715497 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d170e61-dc19-45d7-97af-d1b97a75f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:56.716105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d170e61-dc19-45d7-97af-d1b97a75f5da None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:56.716389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d170e61-dc19-45d7-97af-d1b97a75f5da None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:56.716667 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d170e61-dc19-45d7-97af-d1b97a75f5da None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:56.717316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d170e61-dc19-45d7-97af-d1b97a75f5da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:56.718764 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d170e61-dc19-45d7-97af-d1b97a75f5da None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:56.747521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 586/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:40:56 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:40:58.891970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e886da-d282-4906-b1d7-10ea216a5c9b None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:58.892528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e886da-d282-4906-b1d7-10ea216a5c9b None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:58.892528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e886da-d282-4906-b1d7-10ea216a5c9b None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:58.893837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 588/1174] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:40:58.899188 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaca293-f784-4dfd-aa33-c8f82960e7db None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:58.899609 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaca293-f784-4dfd-aa33-c8f82960e7db None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:58.900256 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaca293-f784-4dfd-aa33-c8f82960e7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:58.918557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-8aaca293-f784-4dfd-aa33-c8f82960e7db None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:40:58.919750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-8aaca293-f784-4dfd-aa33-c8f82960e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:40:58.983204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 587/1175] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:40:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:40:59.250039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e886da-d282-4906-b1d7-10ea216a5c9b None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:59.329535 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:59.352488 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e886da-d282-4906-b1d7-10ea216a5c9b None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:59.385659 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1883365-5e5f-404b-89c1-cc6ea2a84a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:59.386264 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883365-5e5f-404b-89c1-cc6ea2a84a62 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:59.386542 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883365-5e5f-404b-89c1-cc6ea2a84a62 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:59.386815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1883365-5e5f-404b-89c1-cc6ea2a84a62 None admin] PATH_INFO: `/v3/domains/96dac9d5bed249658d01074f99012436` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:59.387928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1883365-5e5f-404b-89c1-cc6ea2a84a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=96dac9d5bed249658d01074f99012436)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:59.389383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1883365-5e5f-404b-89c1-cc6ea2a84a62 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:59.390920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 589/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Oct 3 14:40:59 2022] GET /identity/v3/domains/96dac9d5bed249658d01074f99012436 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:40:59.396717 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaca293-f784-4dfd-aa33-c8f82960e7db None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:40:59.422271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:40:59.493273 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaca293-f784-4dfd-aa33-c8f82960e7db None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:40:59.527455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f666280-332a-4b10-93a9-47b683ca420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:40:59.527998 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666280-332a-4b10-93a9-47b683ca420b None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:40:59.528278 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666280-332a-4b10-93a9-47b683ca420b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:40:59.528551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666280-332a-4b10-93a9-47b683ca420b None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:40:59.529197 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f666280-332a-4b10-93a9-47b683ca420b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:40:59.530608 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f666280-332a-4b10-93a9-47b683ca420b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:40:59.552081 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 588/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:40:59 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:41:01.762541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd1ee4-715e-4564-be9e-b7794c411b62 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:01.763106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd1ee4-715e-4564-be9e-b7794c411b62 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:01.763106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd1ee4-715e-4564-be9e-b7794c411b62 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:01.764446 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 590/1178] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:41:01.769745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c62d74-b308-4691-8ba3-5e335aa03742 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:01.770110 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c62d74-b308-4691-8ba3-5e335aa03742 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:01.770299 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c62d74-b308-4691-8ba3-5e335aa03742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:01.789214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-29c62d74-b308-4691-8ba3-5e335aa03742 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:41:01.790997 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-29c62d74-b308-4691-8ba3-5e335aa03742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:41:01.854716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 589/1179] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:41:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:41:02.127707 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd1ee4-715e-4564-be9e-b7794c411b62 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:02.226917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd1ee4-715e-4564-be9e-b7794c411b62 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:02.260572 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac16ae-ee8c-4afb-bc29-dd23ecbbea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:02.261208 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac16ae-ee8c-4afb-bc29-dd23ecbbea2e None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:02.261489 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac16ae-ee8c-4afb-bc29-dd23ecbbea2e None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:02.261764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac16ae-ee8c-4afb-bc29-dd23ecbbea2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:02.271579 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac16ae-ee8c-4afb-bc29-dd23ecbbea2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-c6ac16ae-ee8c-4afb-bc29-dd23ecbbea2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:41:02.276908 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:41:02.278031 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:41:02.279125 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 591/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:41:02.284110 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c62d74-b308-4691-8ba3-5e335aa03742 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:02.298170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:02.383648 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c62d74-b308-4691-8ba3-5e335aa03742 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:02.415370 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db1a6-2a79-4aa5-81f5-f94a53f74ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:02.416146 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db1a6-2a79-4aa5-81f5-f94a53f74ae9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:02.416452 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db1a6-2a79-4aa5-81f5-f94a53f74ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:02.416722 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db1a6-2a79-4aa5-81f5-f94a53f74ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:02.417367 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db1a6-2a79-4aa5-81f5-f94a53f74ae9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:41:02.417664 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db1a6-2a79-4aa5-81f5-f94a53f74ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:02.419161 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093db1a6-2a79-4aa5-81f5-f94a53f74ae9 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:02.426711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 590/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:02.433601 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac16ae-ee8c-4afb-bc29-dd23ecbbea2e None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:02.437838 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:02.530618 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac16ae-ee8c-4afb-bc29-dd23ecbbea2e None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:02.564517 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5202-3d08-4388-8a35-3028e74563fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:02.565126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5202-3d08-4388-8a35-3028e74563fa None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:02.565403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5202-3d08-4388-8a35-3028e74563fa None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:02.565673 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5202-3d08-4388-8a35-3028e74563fa None admin] PATH_INFO: `/v3/users/e259b7d9b5fb44439226c2b3a1eb6521` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:02.579099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5202-3d08-4388-8a35-3028e74563fa None admin] RBAC: Authorizing `identity:get_user(user_id=e259b7d9b5fb44439226c2b3a1eb6521)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:02.580511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5202-3d08-4388-8a35-3028e74563fa None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:02.582077 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 592/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:41:02 2022] GET /identity/v3/users/e259b7d9b5fb44439226c2b3a1eb6521 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:02.587924 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db1a6-2a79-4aa5-81f5-f94a53f74ae9 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:02.666111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:02.690185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db1a6-2a79-4aa5-81f5-f94a53f74ae9 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:02.721935 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255886a5-d51b-4b04-a63f-049355894611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:02.722540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255886a5-d51b-4b04-a63f-049355894611 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:02.722818 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255886a5-d51b-4b04-a63f-049355894611 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:02.723126 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255886a5-d51b-4b04-a63f-049355894611 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:02.786753 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255886a5-d51b-4b04-a63f-049355894611 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:02.788227 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255886a5-d51b-4b04-a63f-049355894611 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:02.857607 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:02.882560 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 591/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:41:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:41:02.888855 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5202-3d08-4388-8a35-3028e74563fa None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:02.954381 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:02.992691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5202-3d08-4388-8a35-3028e74563fa None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:03.026604 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff46dc8-7368-47a1-8843-93f9fcd364e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:03.027248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff46dc8-7368-47a1-8843-93f9fcd364e4 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:03.027527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff46dc8-7368-47a1-8843-93f9fcd364e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:03.027800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff46dc8-7368-47a1-8843-93f9fcd364e4 None admin] PATH_INFO: `/v3/projects/3e8fd16dec0e447c81f46204d89de7ea` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:03.028880 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff46dc8-7368-47a1-8843-93f9fcd364e4 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8fd16dec0e447c81f46204d89de7ea)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:03.030277 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff46dc8-7368-47a1-8843-93f9fcd364e4 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:03.031911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 593/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:41:02 2022] GET /identity/v3/projects/3e8fd16dec0e447c81f46204d89de7ea => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:03.038160 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255886a5-d51b-4b04-a63f-049355894611 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:03.137332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255886a5-d51b-4b04-a63f-049355894611 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:03.169844 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ca8d2-5bee-4588-a105-2f93bdc855ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:03.170431 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ca8d2-5bee-4588-a105-2f93bdc855ca None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:03.170713 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ca8d2-5bee-4588-a105-2f93bdc855ca None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:03.171008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ca8d2-5bee-4588-a105-2f93bdc855ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:03.171721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ca8d2-5bee-4588-a105-2f93bdc855ca None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=3e8fd16dec0e447c81f46204d89de7ea, user.id=e259b7d9b5fb44439226c2b3a1eb6521) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:41:03.172030 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ca8d2-5bee-4588-a105-2f93bdc855ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:03.173444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ca8d2-5bee-4588-a105-2f93bdc855ca None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:03.178588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 592/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:41:03 2022] GET /identity/v3/role_assignments?user.id=e259b7d9b5fb44439226c2b3a1eb6521&scope.project.id=3e8fd16dec0e447c81f46204d89de7ea&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:05.306925 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf4a0a-2dfd-4aca-b3f0-eaaa36d73292 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:05.307467 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf4a0a-2dfd-4aca-b3f0-eaaa36d73292 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:05.307562 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf4a0a-2dfd-4aca-b3f0-eaaa36d73292 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:05.308886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 594/1186] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:41:05.313938 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928821c-f45a-4cb6-83d7-c008b7251fa5 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:05.314349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928821c-f45a-4cb6-83d7-c008b7251fa5 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:05.314465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928821c-f45a-4cb6-83d7-c008b7251fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:05.332618 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-e928821c-f45a-4cb6-83d7-c008b7251fa5 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:41:05.333780 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-e928821c-f45a-4cb6-83d7-c008b7251fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:41:05.361910 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:05.400072 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 593/1187] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:41:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:41:05.668355 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf4a0a-2dfd-4aca-b3f0-eaaa36d73292 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:05.766733 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf4a0a-2dfd-4aca-b3f0-eaaa36d73292 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:05.794219 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:05.800016 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fda04-8c34-4911-b6db-2c29bcfa612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:05.800640 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fda04-8c34-4911-b6db-2c29bcfa612f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:05.800921 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fda04-8c34-4911-b6db-2c29bcfa612f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:05.801192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fda04-8c34-4911-b6db-2c29bcfa612f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:05.811541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fda04-8c34-4911-b6db-2c29bcfa612f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-239fda04-8c34-4911-b6db-2c29bcfa612f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:41:05.816319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:41:05.817418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:41:05.818497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 595/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:41:05.823499 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928821c-f45a-4cb6-83d7-c008b7251fa5 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:05.918052 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928821c-f45a-4cb6-83d7-c008b7251fa5 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:05.955561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1a75-5c55-4cfb-9842-2c0e1393ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:05.956073 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1a75-5c55-4cfb-9842-2c0e1393ddea None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:05.956354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1a75-5c55-4cfb-9842-2c0e1393ddea None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:05.956625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1a75-5c55-4cfb-9842-2c0e1393ddea None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:05.957284 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1a75-5c55-4cfb-9842-2c0e1393ddea None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:41:05.957586 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1a75-5c55-4cfb-9842-2c0e1393ddea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:05.958935 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d1a75-5c55-4cfb-9842-2c0e1393ddea None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:05.968681 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 594/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:05.974506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fda04-8c34-4911-b6db-2c29bcfa612f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:06.075230 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fda04-8c34-4911-b6db-2c29bcfa612f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:06.110714 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b9398-8dc9-4073-8c3e-26133788010c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:06.111371 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9398-8dc9-4073-8c3e-26133788010c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:06.111654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9398-8dc9-4073-8c3e-26133788010c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:06.111927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b9398-8dc9-4073-8c3e-26133788010c None admin] PATH_INFO: `/v3/users/e259b7d9b5fb44439226c2b3a1eb6521` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:06.113017 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b9398-8dc9-4073-8c3e-26133788010c None admin] RBAC: Authorizing `identity:get_user(user_id=e259b7d9b5fb44439226c2b3a1eb6521)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:06.114425 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b9398-8dc9-4073-8c3e-26133788010c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:06.116020 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 596/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:41:05 2022] GET /identity/v3/users/e259b7d9b5fb44439226c2b3a1eb6521 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:06.121989 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1a75-5c55-4cfb-9842-2c0e1393ddea None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:06.151590 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:06.218452 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1a75-5c55-4cfb-9842-2c0e1393ddea None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:06.250608 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b8325-0bfb-4200-a887-774021f53539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:06.251261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b8325-0bfb-4200-a887-774021f53539 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:06.251541 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b8325-0bfb-4200-a887-774021f53539 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:06.251813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b8325-0bfb-4200-a887-774021f53539 None admin] PATH_INFO: `/v3/projects/3e8fd16dec0e447c81f46204d89de7ea` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:06.252891 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b8325-0bfb-4200-a887-774021f53539 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8fd16dec0e447c81f46204d89de7ea)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:06.254294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b8325-0bfb-4200-a887-774021f53539 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:06.255920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 595/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:41:06 2022] GET /identity/v3/projects/3e8fd16dec0e447c81f46204d89de7ea => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:06.263734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b9398-8dc9-4073-8c3e-26133788010c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:06.322894 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:06.363892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b9398-8dc9-4073-8c3e-26133788010c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:06.396302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fde12e-d8b4-424a-a0ac-88326f4c5f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:06.396955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde12e-d8b4-424a-a0ac-88326f4c5f58 None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:06.397235 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde12e-d8b4-424a-a0ac-88326f4c5f58 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:06.397510 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde12e-d8b4-424a-a0ac-88326f4c5f58 None admin] PATH_INFO: `/v3/projects/3e8fd16dec0e447c81f46204d89de7ea/users/e259b7d9b5fb44439226c2b3a1eb6521/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:06.399392 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fde12e-d8b4-424a-a0ac-88326f4c5f58 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e8fd16dec0e447c81f46204d89de7ea, user_id=e259b7d9b5fb44439226c2b3a1eb6521, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:06.401313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fde12e-d8b4-424a-a0ac-88326f4c5f58 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:06.414503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 597/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:41:06 2022] PUT /identity/v3/projects/3e8fd16dec0e447c81f46204d89de7ea/users/e259b7d9b5fb44439226c2b3a1eb6521/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:41:08.516208 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9af933-e2e1-4606-b164-afb70208db02 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:08.516729 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9af933-e2e1-4606-b164-afb70208db02 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:08.516729 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9af933-e2e1-4606-b164-afb70208db02 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:08.517989 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 596/1193] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:41:08.523277 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec8e6-046c-4f49-937d-da0caa8059fc None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:08.523695 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec8e6-046c-4f49-937d-da0caa8059fc None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:08.523834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ec8e6-046c-4f49-937d-da0caa8059fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:08.542779 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-f34ec8e6-046c-4f49-937d-da0caa8059fc None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:41:08.543976 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-f34ec8e6-046c-4f49-937d-da0caa8059fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:41:08.607204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 598/1194] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:41:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:41:08.873085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9af933-e2e1-4606-b164-afb70208db02 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:08.967406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:08.972305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9af933-e2e1-4606-b164-afb70208db02 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:09.004688 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a4cf4-885f-470c-aa9e-1b1c491650f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:09.005301 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a4cf4-885f-470c-aa9e-1b1c491650f7 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:09.005584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a4cf4-885f-470c-aa9e-1b1c491650f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:09.005861 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a4cf4-885f-470c-aa9e-1b1c491650f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:09.016302 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a4cf4-885f-470c-aa9e-1b1c491650f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-594a4cf4-885f-470c-aa9e-1b1c491650f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:41:09.021118 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:41:09.022035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:41:09.022929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 597/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:41:09.028721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ec8e6-046c-4f49-937d-da0caa8059fc None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:09.077021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:09.127616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ec8e6-046c-4f49-937d-da0caa8059fc None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:09.160115 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9691d4e-408c-4ba1-9043-d01e5611247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:09.160713 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9691d4e-408c-4ba1-9043-d01e5611247c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:09.160993 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9691d4e-408c-4ba1-9043-d01e5611247c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:09.161266 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9691d4e-408c-4ba1-9043-d01e5611247c None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:09.161922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9691d4e-408c-4ba1-9043-d01e5611247c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:41:09.162224 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9691d4e-408c-4ba1-9043-d01e5611247c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:09.163622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9691d4e-408c-4ba1-9043-d01e5611247c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:09.171522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 599/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:09.177976 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a4cf4-885f-470c-aa9e-1b1c491650f7 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:09.273880 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a4cf4-885f-470c-aa9e-1b1c491650f7 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:09.307184 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147fa6f-b0a5-4551-a4db-f81e5ad54268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:09.307976 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147fa6f-b0a5-4551-a4db-f81e5ad54268 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:09.308260 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147fa6f-b0a5-4551-a4db-f81e5ad54268 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:09.308534 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147fa6f-b0a5-4551-a4db-f81e5ad54268 None admin] PATH_INFO: `/v3/users/e259b7d9b5fb44439226c2b3a1eb6521` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:09.309964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147fa6f-b0a5-4551-a4db-f81e5ad54268 None admin] RBAC: Authorizing `identity:get_user(user_id=e259b7d9b5fb44439226c2b3a1eb6521)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:09.312139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147fa6f-b0a5-4551-a4db-f81e5ad54268 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:09.314263 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 598/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Oct 3 14:41:09 2022] GET /identity/v3/users/e259b7d9b5fb44439226c2b3a1eb6521 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:09.320173 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9691d4e-408c-4ba1-9043-d01e5611247c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:09.417262 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9691d4e-408c-4ba1-9043-d01e5611247c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:09.426894 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:09.450345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9c84c-3127-4661-8928-843693226090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:09.450934 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9c84c-3127-4661-8928-843693226090 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:09.451240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9c84c-3127-4661-8928-843693226090 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:09.451508 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9c84c-3127-4661-8928-843693226090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:09.516700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9c84c-3127-4661-8928-843693226090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:09.518113 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9c84c-3127-4661-8928-843693226090 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:09.618413 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 600/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:41:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:41:09.624815 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147fa6f-b0a5-4551-a4db-f81e5ad54268 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:09.655092 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:09.727199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147fa6f-b0a5-4551-a4db-f81e5ad54268 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:09.761219 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e41e6-b3fb-4782-8e04-6cbaa17c0ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:09.762147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e41e6-b3fb-4782-8e04-6cbaa17c0ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:09.762429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e41e6-b3fb-4782-8e04-6cbaa17c0ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:09.762703 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e41e6-b3fb-4782-8e04-6cbaa17c0ec2 None admin] PATH_INFO: `/v3/projects/3e8fd16dec0e447c81f46204d89de7ea` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:09.763865 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e41e6-b3fb-4782-8e04-6cbaa17c0ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=3e8fd16dec0e447c81f46204d89de7ea)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:09.765287 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e41e6-b3fb-4782-8e04-6cbaa17c0ec2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:09.766913 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 599/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Oct 3 14:41:09 2022] GET /identity/v3/projects/3e8fd16dec0e447c81f46204d89de7ea => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:41:09.773075 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9c84c-3127-4661-8928-843693226090 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:41:09.785328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:09.873878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9c84c-3127-4661-8928-843693226090 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:41:09.907082 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566218f5-9267-4dff-89a7-40c287913a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:41:09.907675 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566218f5-9267-4dff-89a7-40c287913a05 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:41:09.907955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566218f5-9267-4dff-89a7-40c287913a05 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:41:09.908229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566218f5-9267-4dff-89a7-40c287913a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:41:09.908946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566218f5-9267-4dff-89a7-40c287913a05 None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=3e8fd16dec0e447c81f46204d89de7ea, user.id=e259b7d9b5fb44439226c2b3a1eb6521) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:41:09.909253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566218f5-9267-4dff-89a7-40c287913a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:41:09.910662 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566218f5-9267-4dff-89a7-40c287913a05 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:41:09.916273 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 601/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:41:09 2022] GET /identity/v3/role_assignments?user.id=e259b7d9b5fb44439226c2b3a1eb6521&scope.project.id=3e8fd16dec0e447c81f46204d89de7ea&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:41:19.756447 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=53 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:41:19.913686 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=63 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:05.899879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fbf33-d707-4428-b2e6-6a505e463560 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:05.900472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fbf33-d707-4428-b2e6-6a505e463560 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:05.900472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fbf33-d707-4428-b2e6-6a505e463560 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:05.901977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 600/1201] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:05.907545 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a35e7-43b6-4378-8503-346bbfb7538a None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:05.908003 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a35e7-43b6-4378-8503-346bbfb7538a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:05.908957 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a35e7-43b6-4378-8503-346bbfb7538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:05.932421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-588a35e7-43b6-4378-8503-346bbfb7538a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:05.933652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-588a35e7-43b6-4378-8503-346bbfb7538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:06.019124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 602/1202] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:06.302908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fbf33-d707-4428-b2e6-6a505e463560 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:06.453801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fbf33-d707-4428-b2e6-6a505e463560 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:06.497811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f6ca-273d-4381-9977-77d68f5888b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:06.498656 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f6ca-273d-4381-9977-77d68f5888b2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:06.499040 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f6ca-273d-4381-9977-77d68f5888b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:06.499357 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f6ca-273d-4381-9977-77d68f5888b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:06.516210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5f6ca-273d-4381-9977-77d68f5888b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:06.517957 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5f6ca-273d-4381-9977-77d68f5888b2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-19f5f6ca-273d-4381-9977-77d68f5888b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:06.539432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:06.540888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:06.542567 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:06.542567 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:06.542567 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:06.547094 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 601/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:06.547721 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a35e7-43b6-4378-8503-346bbfb7538a None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:06.686254 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a35e7-43b6-4378-8503-346bbfb7538a None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:06.725474 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:06.732196 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bab9be-f352-490d-8ad1-af4c37e389e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:06.732875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bab9be-f352-490d-8ad1-af4c37e389e7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:06.733153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bab9be-f352-490d-8ad1-af4c37e389e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:06.733453 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bab9be-f352-490d-8ad1-af4c37e389e7 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:06.734558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bab9be-f352-490d-8ad1-af4c37e389e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:06.734865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bab9be-f352-490d-8ad1-af4c37e389e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:06.736312 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bab9be-f352-490d-8ad1-af4c37e389e7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:06.755010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f6ca-273d-4381-9977-77d68f5888b2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:06.756033 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 603/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:06.832323 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:06.893010 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f6ca-273d-4381-9977-77d68f5888b2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:06.942994 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd64e-0e2e-4508-a6bb-9294db6caf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:06.944431 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd64e-0e2e-4508-a6bb-9294db6caf09 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:06.944723 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd64e-0e2e-4508-a6bb-9294db6caf09 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:06.944989 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd64e-0e2e-4508-a6bb-9294db6caf09 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:06.945647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fd64e-0e2e-4508-a6bb-9294db6caf09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:06.947106 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fd64e-0e2e-4508-a6bb-9294db6caf09 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:06.971957 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 602/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Oct 3 14:42:06 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 14:42:09.389424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13ec6-6155-48bc-b833-fa2d081e69ff None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:09.389976 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13ec6-6155-48bc-b833-fa2d081e69ff None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:09.389976 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13ec6-6155-48bc-b833-fa2d081e69ff None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:09.391504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 604/1206] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:09.396988 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4da5d5-a8ec-4248-9a12-8a77a7d7b273 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:09.400315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4da5d5-a8ec-4248-9a12-8a77a7d7b273 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:09.400315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4da5d5-a8ec-4248-9a12-8a77a7d7b273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:09.417662 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-da4da5d5-a8ec-4248-9a12-8a77a7d7b273 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:09.419205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-da4da5d5-a8ec-4248-9a12-8a77a7d7b273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:09.497737 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 603/1207] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:09.803827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c13ec6-6155-48bc-b833-fa2d081e69ff None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:09.946285 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c13ec6-6155-48bc-b833-fa2d081e69ff None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:09.989221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027a2b3-ccaa-49f8-9382-4df3f07509ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:09.991154 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027a2b3-ccaa-49f8-9382-4df3f07509ed None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:09.991154 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027a2b3-ccaa-49f8-9382-4df3f07509ed None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:09.991154 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027a2b3-ccaa-49f8-9382-4df3f07509ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:10.003077 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027a2b3-ccaa-49f8-9382-4df3f07509ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-3027a2b3-ccaa-49f8-9382-4df3f07509ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:42:10.008326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:10.009406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:42:10.010278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:10.017645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 605/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:42:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:10.017795 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4da5d5-a8ec-4248-9a12-8a77a7d7b273 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:10.077552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:10.173186 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4da5d5-a8ec-4248-9a12-8a77a7d7b273 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:10.222572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905205b-316a-46c3-a4b8-4e873f3ba3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:10.223309 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905205b-316a-46c3-a4b8-4e873f3ba3bc None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:10.223656 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905205b-316a-46c3-a4b8-4e873f3ba3bc None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:10.223997 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905205b-316a-46c3-a4b8-4e873f3ba3bc None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:10.225376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905205b-316a-46c3-a4b8-4e873f3ba3bc None admin] RBAC: Adding query filter params (name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:10.225748 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905205b-316a-46c3-a4b8-4e873f3ba3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:10.227429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905205b-316a-46c3-a4b8-4e873f3ba3bc None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:10.236772 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 604/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:10.243874 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027a2b3-ccaa-49f8-9382-4df3f07509ed None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:10.302640 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:10.358927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027a2b3-ccaa-49f8-9382-4df3f07509ed None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:10.397810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ce72c-9e7e-4a9e-86bd-960d8c9a5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:10.398624 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ce72c-9e7e-4a9e-86bd-960d8c9a5235 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:10.398912 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ce72c-9e7e-4a9e-86bd-960d8c9a5235 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:10.399214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ce72c-9e7e-4a9e-86bd-960d8c9a5235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:10.410491 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ce72c-9e7e-4a9e-86bd-960d8c9a5235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:10.412186 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ce72c-9e7e-4a9e-86bd-960d8c9a5235 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-413ce72c-9e7e-4a9e-86bd-960d8c9a5235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:10.430095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:10.431380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:10.432329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:10.432329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:10.432329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:10.432329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 606/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:10.437150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905205b-316a-46c3-a4b8-4e873f3ba3bc None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:10.546143 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:10.550714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905205b-316a-46c3-a4b8-4e873f3ba3bc None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:10.590048 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4485f7-f8b9-4e2b-a857-bc66d50b389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:10.590614 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4485f7-f8b9-4e2b-a857-bc66d50b389a None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:10.590927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4485f7-f8b9-4e2b-a857-bc66d50b389a None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:10.591326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4485f7-f8b9-4e2b-a857-bc66d50b389a None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:10.591893 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4485f7-f8b9-4e2b-a857-bc66d50b389a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:10.592204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4485f7-f8b9-4e2b-a857-bc66d50b389a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:10.593693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4485f7-f8b9-4e2b-a857-bc66d50b389a None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:10.612298 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 605/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:42:10.613516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ce72c-9e7e-4a9e-86bd-960d8c9a5235 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:10.723872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ce72c-9e7e-4a9e-86bd-960d8c9a5235 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:10.725700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:10.761621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e51af-3179-41c6-8dc2-aa8e3f95d40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:10.762255 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e51af-3179-41c6-8dc2-aa8e3f95d40d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:10.762533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e51af-3179-41c6-8dc2-aa8e3f95d40d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:10.762805 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e51af-3179-41c6-8dc2-aa8e3f95d40d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:10.770652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e51af-3179-41c6-8dc2-aa8e3f95d40d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:10.774724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e51af-3179-41c6-8dc2-aa8e3f95d40d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-069e51af-3179-41c6-8dc2-aa8e3f95d40d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:42:10.788769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:10.789839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:10.795753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 607/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:42:10.796389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4485f7-f8b9-4e2b-a857-bc66d50b389a None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:10.917182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4485f7-f8b9-4e2b-a857-bc66d50b389a None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:10.956346 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb7f4-1b15-44db-ab7d-7b4fd3e65f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:10.957070 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb7f4-1b15-44db-ab7d-7b4fd3e65f21 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:10.957439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb7f4-1b15-44db-ab7d-7b4fd3e65f21 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:10.957802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb7f4-1b15-44db-ab7d-7b4fd3e65f21 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:10.958540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcb7f4-1b15-44db-ab7d-7b4fd3e65f21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:10.958851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcb7f4-1b15-44db-ab7d-7b4fd3e65f21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:10.960970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcb7f4-1b15-44db-ab7d-7b4fd3e65f21 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:10.986995 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 606/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Oct 3 14:42:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:10.988374 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e51af-3179-41c6-8dc2-aa8e3f95d40d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:11.107712 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e51af-3179-41c6-8dc2-aa8e3f95d40d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:11.144461 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3115e-8a63-4eb2-a82b-66eff8a8e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:11.145067 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3115e-8a63-4eb2-a82b-66eff8a8e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:11.145348 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3115e-8a63-4eb2-a82b-66eff8a8e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:11.145621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3115e-8a63-4eb2-a82b-66eff8a8e6c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:11.182009 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:11.226998 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3115e-8a63-4eb2-a82b-66eff8a8e6c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:11.228720 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3115e-8a63-4eb2-a82b-66eff8a8e6c6 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:11.352473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 608/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:42:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:11.358934 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb7f4-1b15-44db-ab7d-7b4fd3e65f21 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:11.382898 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:11.473862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb7f4-1b15-44db-ab7d-7b4fd3e65f21 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:11.511767 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa489640-534a-4814-ba65-cac97686db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:11.512401 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa489640-534a-4814-ba65-cac97686db46 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:11.512679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa489640-534a-4814-ba65-cac97686db46 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:11.512953 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa489640-534a-4814-ba65-cac97686db46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:11.524851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa489640-534a-4814-ba65-cac97686db46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:11.526349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa489640-534a-4814-ba65-cac97686db46 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-fa489640-534a-4814-ba65-cac97686db46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:11.542963 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:11.544128 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:11.545193 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:11.545193 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:11.545193 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:11.546723 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 607/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:42:11.552418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3115e-8a63-4eb2-a82b-66eff8a8e6c6 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:11.622046 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:11.669349 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3115e-8a63-4eb2-a82b-66eff8a8e6c6 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:11.709904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e383e-de86-43ca-b6c0-4c28d0a0ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:11.710411 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e383e-de86-43ca-b6c0-4c28d0a0ee40 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:11.710691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e383e-de86-43ca-b6c0-4c28d0a0ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:11.710984 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e383e-de86-43ca-b6c0-4c28d0a0ee40 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:11.711625 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e383e-de86-43ca-b6c0-4c28d0a0ee40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:11.711930 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e383e-de86-43ca-b6c0-4c28d0a0ee40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:11.713433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e383e-de86-43ca-b6c0-4c28d0a0ee40 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:11.727809 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 609/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:11.735155 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa489640-534a-4814-ba65-cac97686db46 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:11.814990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:11.852551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa489640-534a-4814-ba65-cac97686db46 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:11.889422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bab85-091b-4ec4-98e0-7f66eda2d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:11.890045 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bab85-091b-4ec4-98e0-7f66eda2d8ce None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:11.890329 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bab85-091b-4ec4-98e0-7f66eda2d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:11.890606 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bab85-091b-4ec4-98e0-7f66eda2d8ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:11.898333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bab85-091b-4ec4-98e0-7f66eda2d8ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:11.899891 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bab85-091b-4ec4-98e0-7f66eda2d8ce None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-286bab85-091b-4ec4-98e0-7f66eda2d8ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:42:11.912075 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:11.913465 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:11.914702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:42:11.914702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:42:11.914702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:42:11.914702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:42:11.914702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:42:11.914702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:42:11.914702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:11.914702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:11.916920 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 608/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:11.922745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e383e-de86-43ca-b6c0-4c28d0a0ee40 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:12.059782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e383e-de86-43ca-b6c0-4c28d0a0ee40 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:12.096897 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:12.109402 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3f7ab-8100-471a-87ab-a5b40daf4f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:12.110106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3f7ab-8100-471a-87ab-a5b40daf4f5f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:12.110530 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3f7ab-8100-471a-87ab-a5b40daf4f5f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:12.110875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3f7ab-8100-471a-87ab-a5b40daf4f5f None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:12.111665 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3f7ab-8100-471a-87ab-a5b40daf4f5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:12.112032 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3f7ab-8100-471a-87ab-a5b40daf4f5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:12.113538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3f7ab-8100-471a-87ab-a5b40daf4f5f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:12.130830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 610/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:42:12.137612 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bab85-091b-4ec4-98e0-7f66eda2d8ce None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:12.247899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bab85-091b-4ec4-98e0-7f66eda2d8ce None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:12.277663 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:12.283949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59957d9-dbea-4cf5-bb92-37486aabed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:12.284559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59957d9-dbea-4cf5-bb92-37486aabed38 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:12.284841 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59957d9-dbea-4cf5-bb92-37486aabed38 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:12.285140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59957d9-dbea-4cf5-bb92-37486aabed38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:12.285862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59957d9-dbea-4cf5-bb92-37486aabed38 None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=d89b836f341b419dad35887c46d68730) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:12.286171 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59957d9-dbea-4cf5-bb92-37486aabed38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:12.288870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59957d9-dbea-4cf5-bb92-37486aabed38 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:12.294528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 609/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:42:12 2022] GET /identity/v3/role_assignments?user.id=d89b836f341b419dad35887c46d68730&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:14.439197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91504a05-1561-4b47-a18b-e457013f0abf None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:14.439747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91504a05-1561-4b47-a18b-e457013f0abf None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:14.439842 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91504a05-1561-4b47-a18b-e457013f0abf None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:14.441635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 611/1220] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:14.447051 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ae232-97a0-4095-b4d3-9a8c776fc658 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:14.447496 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ae232-97a0-4095-b4d3-9a8c776fc658 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:14.447599 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ae232-97a0-4095-b4d3-9a8c776fc658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:14.466361 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-602ae232-97a0-4095-b4d3-9a8c776fc658 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:14.467584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-602ae232-97a0-4095-b4d3-9a8c776fc658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:14.541336 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 610/1221] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:14.818780 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91504a05-1561-4b47-a18b-e457013f0abf None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:14.934795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91504a05-1561-4b47-a18b-e457013f0abf None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:14.971840 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf9811-b139-4a90-acdf-b3becf0b5bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:14.972551 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf9811-b139-4a90-acdf-b3becf0b5bfc None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:14.972847 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf9811-b139-4a90-acdf-b3becf0b5bfc None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:14.973204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf9811-b139-4a90-acdf-b3becf0b5bfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:14.985106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf9811-b139-4a90-acdf-b3becf0b5bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-7ebf9811-b139-4a90-acdf-b3becf0b5bfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:42:14.989987 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:14.991452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:14.992497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 612/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:42:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:15.001977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ae232-97a0-4095-b4d3-9a8c776fc658 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:15.119262 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ae232-97a0-4095-b4d3-9a8c776fc658 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:15.145477 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:15.157235 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7847-029f-42b5-aa48-a7cdf353c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:15.157849 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7847-029f-42b5-aa48-a7cdf353c04b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:15.158127 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7847-029f-42b5-aa48-a7cdf353c04b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:15.158396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e7847-029f-42b5-aa48-a7cdf353c04b None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:15.159086 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e7847-029f-42b5-aa48-a7cdf353c04b None admin] RBAC: Adding query filter params (name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:15.159388 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e7847-029f-42b5-aa48-a7cdf353c04b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:15.160734 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e7847-029f-42b5-aa48-a7cdf353c04b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:15.168773 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 611/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:15.174558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf9811-b139-4a90-acdf-b3becf0b5bfc None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:15.219197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:15.279948 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf9811-b139-4a90-acdf-b3becf0b5bfc None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:15.321819 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab2bf9-7b32-4e3c-bc2f-54e76ff0baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:15.322679 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab2bf9-7b32-4e3c-bc2f-54e76ff0baa2 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:15.323121 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab2bf9-7b32-4e3c-bc2f-54e76ff0baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:15.323550 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab2bf9-7b32-4e3c-bc2f-54e76ff0baa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:15.337499 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab2bf9-7b32-4e3c-bc2f-54e76ff0baa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:15.339318 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab2bf9-7b32-4e3c-bc2f-54e76ff0baa2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-44ab2bf9-7b32-4e3c-bc2f-54e76ff0baa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:15.359555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:15.360728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:15.361791 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:15.361791 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:15.361791 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:15.361791 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 613/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:42:15.367981 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7847-029f-42b5-aa48-a7cdf353c04b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:15.480052 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e7847-029f-42b5-aa48-a7cdf353c04b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:15.514647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac07761-515d-443e-9a94-0bf431423431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:15.515310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac07761-515d-443e-9a94-0bf431423431 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:15.515625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac07761-515d-443e-9a94-0bf431423431 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:15.515916 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac07761-515d-443e-9a94-0bf431423431 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:15.516675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac07761-515d-443e-9a94-0bf431423431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:15.516993 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac07761-515d-443e-9a94-0bf431423431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:15.518533 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac07761-515d-443e-9a94-0bf431423431 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:15.531620 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 612/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:15.538325 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab2bf9-7b32-4e3c-bc2f-54e76ff0baa2 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:15.641956 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:15.651258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab2bf9-7b32-4e3c-bc2f-54e76ff0baa2 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:15.692258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518180-5edf-4431-af47-3e20049066ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:15.692939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518180-5edf-4431-af47-3e20049066ca None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:15.693221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518180-5edf-4431-af47-3e20049066ca None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:15.694467 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518180-5edf-4431-af47-3e20049066ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:15.702148 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa518180-5edf-4431-af47-3e20049066ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:15.703705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa518180-5edf-4431-af47-3e20049066ca None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-fa518180-5edf-4431-af47-3e20049066ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:42:15.715889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:15.717133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:15.718859 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 614/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:15.723494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac07761-515d-443e-9a94-0bf431423431 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:15.771511 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:15.844257 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac07761-515d-443e-9a94-0bf431423431 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:15.886776 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea427f1d-8856-4300-9acd-dddaacafc800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:15.887412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea427f1d-8856-4300-9acd-dddaacafc800 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:15.887697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea427f1d-8856-4300-9acd-dddaacafc800 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:15.888037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea427f1d-8856-4300-9acd-dddaacafc800 None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:15.888732 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea427f1d-8856-4300-9acd-dddaacafc800 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:15.889011 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea427f1d-8856-4300-9acd-dddaacafc800 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:15.890437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea427f1d-8856-4300-9acd-dddaacafc800 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:15.907951 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 613/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Oct 3 14:42:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:15.913869 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518180-5edf-4431-af47-3e20049066ca None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:16.019368 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518180-5edf-4431-af47-3e20049066ca None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:16.060605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7d3f1-26b6-4fe8-946c-aaaec5af3c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:16.061234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7d3f1-26b6-4fe8-946c-aaaec5af3c75 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:16.061514 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7d3f1-26b6-4fe8-946c-aaaec5af3c75 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:16.061788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7d3f1-26b6-4fe8-946c-aaaec5af3c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:16.073909 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7d3f1-26b6-4fe8-946c-aaaec5af3c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:16.075507 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7d3f1-26b6-4fe8-946c-aaaec5af3c75 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-86d7d3f1-26b6-4fe8-946c-aaaec5af3c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:16.093631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:16.094816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:16.095960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:16.095960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:16.095960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:16.095960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 615/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:42:16.100862 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea427f1d-8856-4300-9acd-dddaacafc800 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:16.207107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea427f1d-8856-4300-9acd-dddaacafc800 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:16.209437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:16.244035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e79911-371a-4433-bf9f-6139555b99f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:16.244649 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79911-371a-4433-bf9f-6139555b99f2 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:16.244933 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79911-371a-4433-bf9f-6139555b99f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:16.245210 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79911-371a-4433-bf9f-6139555b99f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:16.245861 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e79911-371a-4433-bf9f-6139555b99f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:16.246156 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e79911-371a-4433-bf9f-6139555b99f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:16.247553 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e79911-371a-4433-bf9f-6139555b99f2 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:16.259586 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 614/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:16.266248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7d3f1-26b6-4fe8-946c-aaaec5af3c75 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:16.276378 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:16.383922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7d3f1-26b6-4fe8-946c-aaaec5af3c75 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:16.421757 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc977b-f1de-4c3c-9bf0-e727c812d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:16.422390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc977b-f1de-4c3c-9bf0-e727c812d65d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:16.422681 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc977b-f1de-4c3c-9bf0-e727c812d65d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:16.422939 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc977b-f1de-4c3c-9bf0-e727c812d65d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:16.431296 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc977b-f1de-4c3c-9bf0-e727c812d65d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:16.432896 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc977b-f1de-4c3c-9bf0-e727c812d65d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-62dc977b-f1de-4c3c-9bf0-e727c812d65d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:42:16.445636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:16.446751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:16.447890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:42:16.447890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:42:16.447890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:42:16.447890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:42:16.447890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:42:16.447890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:42:16.447890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:16.447890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:16.447890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 616/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:16.453138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e79911-371a-4433-bf9f-6139555b99f2 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:16.564420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e79911-371a-4433-bf9f-6139555b99f2 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:16.602356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d036a7-68d2-48aa-a44b-8ad850ee55bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:16.602994 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d036a7-68d2-48aa-a44b-8ad850ee55bb None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:16.603322 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d036a7-68d2-48aa-a44b-8ad850ee55bb None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:16.603598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d036a7-68d2-48aa-a44b-8ad850ee55bb None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:16.604327 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d036a7-68d2-48aa-a44b-8ad850ee55bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:16.604688 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d036a7-68d2-48aa-a44b-8ad850ee55bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:16.606185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d036a7-68d2-48aa-a44b-8ad850ee55bb None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:16.619237 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 615/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:16.626104 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc977b-f1de-4c3c-9bf0-e727c812d65d None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:16.696899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:16.735294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc977b-f1de-4c3c-9bf0-e727c812d65d None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:16.771070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8becc81-c7c2-4c50-99a1-9e4ccd3fc6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:16.772431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becc81-c7c2-4c50-99a1-9e4ccd3fc6a2 None admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:16.772738 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becc81-c7c2-4c50-99a1-9e4ccd3fc6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:16.773064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8becc81-c7c2-4c50-99a1-9e4ccd3fc6a2 None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/d89b836f341b419dad35887c46d68730/roles/2a99e98f227647c7af60a10d5fe5ad3c` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:16.792015 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8becc81-c7c2-4c50-99a1-9e4ccd3fc6a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=d89b836f341b419dad35887c46d68730, role_id=2a99e98f227647c7af60a10d5fe5ad3c)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:16.793806 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8becc81-c7c2-4c50-99a1-9e4ccd3fc6a2 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:16.807501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 617/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:42:16 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/d89b836f341b419dad35887c46d68730/roles/2a99e98f227647c7af60a10d5fe5ad3c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:42:19.095423 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb521e8-4152-49b2-a95b-2d7ba829aff9 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:19.095856 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb521e8-4152-49b2-a95b-2d7ba829aff9 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:19.095964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb521e8-4152-49b2-a95b-2d7ba829aff9 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:19.097448 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 616/1233] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:19.102915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21344729-b655-47b7-ae2f-a49fde50aac9 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:19.103386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21344729-b655-47b7-ae2f-a49fde50aac9 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:19.103477 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21344729-b655-47b7-ae2f-a49fde50aac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:19.122519 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-21344729-b655-47b7-ae2f-a49fde50aac9 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:19.123805 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-21344729-b655-47b7-ae2f-a49fde50aac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:19.198332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 618/1234] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:19.482538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb521e8-4152-49b2-a95b-2d7ba829aff9 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:19.512834 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:19.602960 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb521e8-4152-49b2-a95b-2d7ba829aff9 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:19.641732 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4785d3-b046-436b-afc8-da4b23411695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:19.642676 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4785d3-b046-436b-afc8-da4b23411695 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:19.642971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4785d3-b046-436b-afc8-da4b23411695 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:19.643376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4785d3-b046-436b-afc8-da4b23411695 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:19.654006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4785d3-b046-436b-afc8-da4b23411695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-7d4785d3-b046-436b-afc8-da4b23411695 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:42:19.658908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:19.660488 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:19.661655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 617/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Oct 3 14:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:42:19.666538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21344729-b655-47b7-ae2f-a49fde50aac9 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:19.723426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:19.783554 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21344729-b655-47b7-ae2f-a49fde50aac9 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:19.822647 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254c71b-8556-4800-8dde-2bae54a429a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:19.823358 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254c71b-8556-4800-8dde-2bae54a429a5 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:19.823666 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254c71b-8556-4800-8dde-2bae54a429a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:19.823973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254c71b-8556-4800-8dde-2bae54a429a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:19.824795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254c71b-8556-4800-8dde-2bae54a429a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:19.825171 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254c71b-8556-4800-8dde-2bae54a429a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:19.826864 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254c71b-8556-4800-8dde-2bae54a429a5 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:19.837570 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 619/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Oct 3 14:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:42:19.843408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4785d3-b046-436b-afc8-da4b23411695 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:19.933464 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:19.952290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4785d3-b046-436b-afc8-da4b23411695 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:19.992908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c979f3-ac9b-4d16-b646-3bbcf2feb8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:19.993802 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c979f3-ac9b-4d16-b646-3bbcf2feb8fd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:19.994085 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c979f3-ac9b-4d16-b646-3bbcf2feb8fd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:19.994364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c979f3-ac9b-4d16-b646-3bbcf2feb8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:20.005170 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c979f3-ac9b-4d16-b646-3bbcf2feb8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:20.007337 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c979f3-ac9b-4d16-b646-3bbcf2feb8fd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-55c979f3-ac9b-4d16-b646-3bbcf2feb8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:20.023901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:20.024996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:20.025921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:20.025921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:20.025921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:20.025921 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 618/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:20.035040 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254c71b-8556-4800-8dde-2bae54a429a5 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:20.148682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254c71b-8556-4800-8dde-2bae54a429a5 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:20.158112 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:20.188489 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930ddfa-3066-4be1-b5eb-1d13e9de19be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:20.189105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930ddfa-3066-4be1-b5eb-1d13e9de19be None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:20.189382 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930ddfa-3066-4be1-b5eb-1d13e9de19be None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:20.189657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930ddfa-3066-4be1-b5eb-1d13e9de19be None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:20.190287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930ddfa-3066-4be1-b5eb-1d13e9de19be None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:20.190589 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930ddfa-3066-4be1-b5eb-1d13e9de19be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:20.191972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930ddfa-3066-4be1-b5eb-1d13e9de19be None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:20.204687 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 620/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:42:20.211238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c979f3-ac9b-4d16-b646-3bbcf2feb8fd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:20.320590 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c979f3-ac9b-4d16-b646-3bbcf2feb8fd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:20.358208 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7159c3-b208-47eb-8f77-9fda9d477525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:20.358845 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7159c3-b208-47eb-8f77-9fda9d477525 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:20.359153 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7159c3-b208-47eb-8f77-9fda9d477525 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:20.359426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7159c3-b208-47eb-8f77-9fda9d477525 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:20.362205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:20.367660 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7159c3-b208-47eb-8f77-9fda9d477525 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:20.369544 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7159c3-b208-47eb-8f77-9fda9d477525 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-1b7159c3-b208-47eb-8f77-9fda9d477525 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:42:20.382362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:20.383604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:20.385068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 619/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:20.389376 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930ddfa-3066-4be1-b5eb-1d13e9de19be None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:20.495889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930ddfa-3066-4be1-b5eb-1d13e9de19be None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:20.532172 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ec1cc-618c-4cc1-b9c6-848f97e72f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:20.532804 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ec1cc-618c-4cc1-b9c6-848f97e72f0c None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:20.533086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ec1cc-618c-4cc1-b9c6-848f97e72f0c None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:20.533366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ec1cc-618c-4cc1-b9c6-848f97e72f0c None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:20.534089 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ec1cc-618c-4cc1-b9c6-848f97e72f0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:20.534394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ec1cc-618c-4cc1-b9c6-848f97e72f0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:20.535891 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ec1cc-618c-4cc1-b9c6-848f97e72f0c None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:20.557159 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 621/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Oct 3 14:42:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:20.563103 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7159c3-b208-47eb-8f77-9fda9d477525 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:20.671748 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7159c3-b208-47eb-8f77-9fda9d477525 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:20.706720 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8ad2d-a1ed-4ff1-90c0-b512e1c5a62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:20.707512 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8ad2d-a1ed-4ff1-90c0-b512e1c5a62b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:20.707799 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8ad2d-a1ed-4ff1-90c0-b512e1c5a62b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:20.708168 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8ad2d-a1ed-4ff1-90c0-b512e1c5a62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:20.776519 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:20.784326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8ad2d-a1ed-4ff1-90c0-b512e1c5a62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:20.785765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8ad2d-a1ed-4ff1-90c0-b512e1c5a62b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:20.906992 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 620/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:42:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:20.908232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ec1cc-618c-4cc1-b9c6-848f97e72f0c None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:20.940902 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:21.024268 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ec1cc-618c-4cc1-b9c6-848f97e72f0c None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:21.061716 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4c66b-189e-4402-816c-dfc3caf30294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:21.062346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4c66b-189e-4402-816c-dfc3caf30294 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:21.062619 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4c66b-189e-4402-816c-dfc3caf30294 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:21.063005 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4c66b-189e-4402-816c-dfc3caf30294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:21.072927 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4c66b-189e-4402-816c-dfc3caf30294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:21.074391 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4c66b-189e-4402-816c-dfc3caf30294 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-1bd4c66b-189e-4402-816c-dfc3caf30294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:21.089571 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:21.090635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:21.096516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:21.096516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:21.096516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:21.096516 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 622/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:21.096760 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8ad2d-a1ed-4ff1-90c0-b512e1c5a62b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:21.201002 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:21.207704 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8ad2d-a1ed-4ff1-90c0-b512e1c5a62b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:21.247752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d06e6-5273-4b15-8ba5-6157e43c9224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:21.248452 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d06e6-5273-4b15-8ba5-6157e43c9224 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:21.248639 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d06e6-5273-4b15-8ba5-6157e43c9224 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:21.248914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d06e6-5273-4b15-8ba5-6157e43c9224 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:21.249551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d06e6-5273-4b15-8ba5-6157e43c9224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:21.249857 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d06e6-5273-4b15-8ba5-6157e43c9224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:21.251549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d06e6-5273-4b15-8ba5-6157e43c9224 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:21.266206 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 621/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:21.270279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4c66b-189e-4402-816c-dfc3caf30294 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:21.358197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:21.388097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4c66b-189e-4402-816c-dfc3caf30294 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:21.427037 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237eed52-be2f-423f-9f97-387d4320a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:21.428295 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eed52-be2f-423f-9f97-387d4320a4ad None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:21.428554 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eed52-be2f-423f-9f97-387d4320a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:21.428879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eed52-be2f-423f-9f97-387d4320a4ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:21.436366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237eed52-be2f-423f-9f97-387d4320a4ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:21.438026 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237eed52-be2f-423f-9f97-387d4320a4ad None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-237eed52-be2f-423f-9f97-387d4320a4ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:42:21.451380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:21.452492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:21.453608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:42:21.453608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:42:21.453608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:42:21.453608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:42:21.453608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:42:21.453608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:42:21.453608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:21.453608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:21.453608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 623/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:21.458711 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d06e6-5273-4b15-8ba5-6157e43c9224 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:21.572029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d06e6-5273-4b15-8ba5-6157e43c9224 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:21.609436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8af59-2659-4be8-8697-88bf5c8f22a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:21.610192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8af59-2659-4be8-8697-88bf5c8f22a9 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:21.610478 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8af59-2659-4be8-8697-88bf5c8f22a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:21.610756 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8af59-2659-4be8-8697-88bf5c8f22a9 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:21.611580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8af59-2659-4be8-8697-88bf5c8f22a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:21.611897 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8af59-2659-4be8-8697-88bf5c8f22a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:21.613524 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8af59-2659-4be8-8697-88bf5c8f22a9 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:21.628071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 622/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:21.635004 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237eed52-be2f-423f-9f97-387d4320a4ad None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:21.755973 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237eed52-be2f-423f-9f97-387d4320a4ad None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:21.796375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a36b9-d0f0-4574-8c80-e34a5e24e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:21.797168 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a36b9-d0f0-4574-8c80-e34a5e24e95f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:21.797502 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a36b9-d0f0-4574-8c80-e34a5e24e95f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:21.797788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a36b9-d0f0-4574-8c80-e34a5e24e95f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:21.798535 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a36b9-d0f0-4574-8c80-e34a5e24e95f None admin] RBAC: Adding query filter params (role.id=2a99e98f227647c7af60a10d5fe5ad3c, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=d89b836f341b419dad35887c46d68730) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:21.798898 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a36b9-d0f0-4574-8c80-e34a5e24e95f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:21.800620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a36b9-d0f0-4574-8c80-e34a5e24e95f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:21.807900 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 624/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:42:21 2022] GET /identity/v3/role_assignments?user.id=d89b836f341b419dad35887c46d68730&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=2a99e98f227647c7af60a10d5fe5ad3c => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:42:24.254978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dbc7e-2fb6-406e-bd25-8e0231589b85 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:24.255513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dbc7e-2fb6-406e-bd25-8e0231589b85 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:24.255646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dbc7e-2fb6-406e-bd25-8e0231589b85 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:24.257230 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 623/1247] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:24.262403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddeb4c-188c-48e7-946f-d5e0d8801027 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:24.262876 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddeb4c-188c-48e7-946f-d5e0d8801027 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:24.262994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddeb4c-188c-48e7-946f-d5e0d8801027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:24.269313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:24.282428 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-feddeb4c-188c-48e7-946f-d5e0d8801027 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:24.283631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-feddeb4c-188c-48e7-946f-d5e0d8801027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:24.359249 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 625/1248] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:24.633105 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dbc7e-2fb6-406e-bd25-8e0231589b85 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:24.656695 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:24.755438 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dbc7e-2fb6-406e-bd25-8e0231589b85 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:24.802037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ba9e-9ebb-48fa-b2fa-a66c1ca770e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:24.803652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ba9e-9ebb-48fa-b2fa-a66c1ca770e4 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:24.804149 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ba9e-9ebb-48fa-b2fa-a66c1ca770e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:24.804647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ba9e-9ebb-48fa-b2fa-a66c1ca770e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:24.818669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94ba9e-9ebb-48fa-b2fa-a66c1ca770e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-5e94ba9e-9ebb-48fa-b2fa-a66c1ca770e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:42:24.824455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:24.825433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:42:24.826315 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:24.831145 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 624/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:24.832460 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddeb4c-188c-48e7-946f-d5e0d8801027 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:24.946282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddeb4c-188c-48e7-946f-d5e0d8801027 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:24.980143 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:24.986012 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eab17-96c1-492d-8de3-d15f347474de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:24.986630 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eab17-96c1-492d-8de3-d15f347474de None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:24.986910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eab17-96c1-492d-8de3-d15f347474de None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:24.987214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eab17-96c1-492d-8de3-d15f347474de None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:24.987874 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eab17-96c1-492d-8de3-d15f347474de None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:24.988178 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eab17-96c1-492d-8de3-d15f347474de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:24.989533 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eab17-96c1-492d-8de3-d15f347474de None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:24.999609 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 626/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 14:42:25.007411 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ba9e-9ebb-48fa-b2fa-a66c1ca770e4 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:25.109249 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:25.133824 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ba9e-9ebb-48fa-b2fa-a66c1ca770e4 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:25.177801 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf879-1930-42ef-96b9-a5f21fb08e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:25.178530 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf879-1930-42ef-96b9-a5f21fb08e3b None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:25.178872 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf879-1930-42ef-96b9-a5f21fb08e3b None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:25.179202 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bf879-1930-42ef-96b9-a5f21fb08e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:25.193811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf879-1930-42ef-96b9-a5f21fb08e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:25.195749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bf879-1930-42ef-96b9-a5f21fb08e3b None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-019bf879-1930-42ef-96b9-a5f21fb08e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:25.216215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:25.218330 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:25.220421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:25.220421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:25.220421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:25.220421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 625/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:25.223426 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eab17-96c1-492d-8de3-d15f347474de None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:25.355749 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eab17-96c1-492d-8de3-d15f347474de None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:25.400732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00444425-a179-4cc4-8518-54bb3aa48f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:25.401366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444425-a179-4cc4-8518-54bb3aa48f8f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:25.401645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444425-a179-4cc4-8518-54bb3aa48f8f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:25.401919 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444425-a179-4cc4-8518-54bb3aa48f8f None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:25.402584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00444425-a179-4cc4-8518-54bb3aa48f8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:25.402887 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00444425-a179-4cc4-8518-54bb3aa48f8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:25.404501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00444425-a179-4cc4-8518-54bb3aa48f8f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:25.418383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 627/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:25.426455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf879-1930-42ef-96b9-a5f21fb08e3b None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:25.542162 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bf879-1930-42ef-96b9-a5f21fb08e3b None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:25.571239 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:25.579938 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2eac44-5caf-4e32-b199-3fd322d880b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:25.580592 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eac44-5caf-4e32-b199-3fd322d880b8 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:25.580880 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eac44-5caf-4e32-b199-3fd322d880b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:25.581153 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eac44-5caf-4e32-b199-3fd322d880b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:25.589966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2eac44-5caf-4e32-b199-3fd322d880b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:25.591457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2eac44-5caf-4e32-b199-3fd322d880b8 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-cf2eac44-5caf-4e32-b199-3fd322d880b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:42:25.603407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:25.604595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:25.605890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 626/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:25.610481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00444425-a179-4cc4-8518-54bb3aa48f8f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:25.670607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:25.717853 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00444425-a179-4cc4-8518-54bb3aa48f8f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:25.753642 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a9c95-dab6-4f22-8cef-08eae424e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:25.754244 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a9c95-dab6-4f22-8cef-08eae424e8c4 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:25.754525 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a9c95-dab6-4f22-8cef-08eae424e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:25.754788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a9c95-dab6-4f22-8cef-08eae424e8c4 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:25.756159 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a9c95-dab6-4f22-8cef-08eae424e8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:25.756419 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a9c95-dab6-4f22-8cef-08eae424e8c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:25.757851 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a9c95-dab6-4f22-8cef-08eae424e8c4 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:25.776447 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 628/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Oct 3 14:42:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:25.782600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2eac44-5caf-4e32-b199-3fd322d880b8 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:25.896829 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2eac44-5caf-4e32-b199-3fd322d880b8 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:25.932055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026c94-9f0e-4cda-9cbe-731150b0e8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:25.932672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026c94-9f0e-4cda-9cbe-731150b0e8cb None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:25.932959 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026c94-9f0e-4cda-9cbe-731150b0e8cb None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:25.933233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026c94-9f0e-4cda-9cbe-731150b0e8cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:25.989358 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:26.002970 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026c94-9f0e-4cda-9cbe-731150b0e8cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:26.004422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026c94-9f0e-4cda-9cbe-731150b0e8cb None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:26.099749 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 627/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:42:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:26.106029 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a9c95-dab6-4f22-8cef-08eae424e8c4 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:26.203127 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a9c95-dab6-4f22-8cef-08eae424e8c4 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:26.215882 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:26.236861 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8650-6ba5-4bdd-9356-68e3fe510d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:26.237473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8650-6ba5-4bdd-9356-68e3fe510d23 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:26.237750 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8650-6ba5-4bdd-9356-68e3fe510d23 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:26.238021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8650-6ba5-4bdd-9356-68e3fe510d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:26.248914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8650-6ba5-4bdd-9356-68e3fe510d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:26.250320 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8650-6ba5-4bdd-9356-68e3fe510d23 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-76db8650-6ba5-4bdd-9356-68e3fe510d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:26.264691 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:26.265798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:26.266875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:26.266875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:26.266875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:26.266875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 629/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:26.272012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026c94-9f0e-4cda-9cbe-731150b0e8cb None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:26.358279 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:26.370159 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026c94-9f0e-4cda-9cbe-731150b0e8cb None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:26.402482 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23e46-36de-4186-a85e-094ad7508476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:26.403104 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23e46-36de-4186-a85e-094ad7508476 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:26.403385 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23e46-36de-4186-a85e-094ad7508476 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:26.403654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23e46-36de-4186-a85e-094ad7508476 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:26.404271 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb23e46-36de-4186-a85e-094ad7508476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:26.404569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb23e46-36de-4186-a85e-094ad7508476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:26.405907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb23e46-36de-4186-a85e-094ad7508476 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:26.417276 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 628/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:26.422889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8650-6ba5-4bdd-9356-68e3fe510d23 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:26.519954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8650-6ba5-4bdd-9356-68e3fe510d23 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:26.552696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34bd18-cc6f-4371-9dab-a77b008b9143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:26.553336 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34bd18-cc6f-4371-9dab-a77b008b9143 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:26.553619 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34bd18-cc6f-4371-9dab-a77b008b9143 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:26.553896 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34bd18-cc6f-4371-9dab-a77b008b9143 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:26.560293 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34bd18-cc6f-4371-9dab-a77b008b9143 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:26.561708 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34bd18-cc6f-4371-9dab-a77b008b9143 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-bf34bd18-cc6f-4371-9dab-a77b008b9143 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:42:26.572584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:26.573616 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:26.574722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:42:26.574722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:42:26.574722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:42:26.574722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:42:26.574722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:42:26.574722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:42:26.574722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:26.574722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:26.574722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 630/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:26.579609 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23e46-36de-4186-a85e-094ad7508476 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:26.676471 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23e46-36de-4186-a85e-094ad7508476 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:26.708786 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a544c-eaf7-41a7-9059-acb77fff2bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:26.709382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a544c-eaf7-41a7-9059-acb77fff2bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:26.709668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a544c-eaf7-41a7-9059-acb77fff2bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:26.709944 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a544c-eaf7-41a7-9059-acb77fff2bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:26.710623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a544c-eaf7-41a7-9059-acb77fff2bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:26.710929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a544c-eaf7-41a7-9059-acb77fff2bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:26.712358 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a544c-eaf7-41a7-9059-acb77fff2bc5 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:26.723723 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 629/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:26.730224 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34bd18-cc6f-4371-9dab-a77b008b9143 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:26.755853 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:26.832434 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34bd18-cc6f-4371-9dab-a77b008b9143 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:26.865710 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597377c-f1c3-4763-bbf6-f0c4ca4ee5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:26.866298 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597377c-f1c3-4763-bbf6-f0c4ca4ee5b8 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:26.866582 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597377c-f1c3-4763-bbf6-f0c4ca4ee5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:26.866857 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597377c-f1c3-4763-bbf6-f0c4ca4ee5b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:26.867608 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597377c-f1c3-4763-bbf6-f0c4ca4ee5b8 None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=d89b836f341b419dad35887c46d68730) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:26.867918 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597377c-f1c3-4763-bbf6-f0c4ca4ee5b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:26.869581 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597377c-f1c3-4763-bbf6-f0c4ca4ee5b8 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:26.874764 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 631/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:42:26 2022] GET /identity/v3/role_assignments?user.id=d89b836f341b419dad35887c46d68730&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:29.000755 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7d956-8b68-43dd-990f-abf43f50c9d5 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:29.001318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7d956-8b68-43dd-990f-abf43f50c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:29.001318 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7d956-8b68-43dd-990f-abf43f50c9d5 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:29.002628 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 630/1261] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:29.007831 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8ac0-f7db-4b5c-abf1-9f41bb1b4608 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:29.008256 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8ac0-f7db-4b5c-abf1-9f41bb1b4608 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:29.008362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb8ac0-f7db-4b5c-abf1-9f41bb1b4608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:29.026213 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-ddeb8ac0-f7db-4b5c-abf1-9f41bb1b4608 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:29.027401 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-ddeb8ac0-f7db-4b5c-abf1-9f41bb1b4608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:29.090828 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 632/1262] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:29.354798 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7d956-8b68-43dd-990f-abf43f50c9d5 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:29.365572 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:29.454123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7d956-8b68-43dd-990f-abf43f50c9d5 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:29.486990 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7c50-c474-4343-a1eb-17c9941d111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:29.487611 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7c50-c474-4343-a1eb-17c9941d111e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:29.487889 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7c50-c474-4343-a1eb-17c9941d111e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:29.488161 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7c50-c474-4343-a1eb-17c9941d111e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:29.498204 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c7c50-c474-4343-a1eb-17c9941d111e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-e34c7c50-c474-4343-a1eb-17c9941d111e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:42:29.502968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:29.504096 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:29.505150 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 631/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:42:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:29.510061 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8ac0-f7db-4b5c-abf1-9f41bb1b4608 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:29.528541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:29.607385 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb8ac0-f7db-4b5c-abf1-9f41bb1b4608 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:29.639283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0ff96-4755-4e8c-8be1-64b4ef927b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:29.639882 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0ff96-4755-4e8c-8be1-64b4ef927b58 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:29.640161 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0ff96-4755-4e8c-8be1-64b4ef927b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:29.640432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0ff96-4755-4e8c-8be1-64b4ef927b58 None admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:29.641082 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0ff96-4755-4e8c-8be1-64b4ef927b58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:29.641380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0ff96-4755-4e8c-8be1-64b4ef927b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:29.642722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0ff96-4755-4e8c-8be1-64b4ef927b58 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:29.650922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 633/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:42:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:29.656780 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7c50-c474-4343-a1eb-17c9941d111e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:29.721625 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:29.756684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7c50-c474-4343-a1eb-17c9941d111e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:29.793363 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce5629-0515-4057-93f2-89d4abdadcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:29.793981 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5629-0515-4057-93f2-89d4abdadcdc None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:29.794261 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5629-0515-4057-93f2-89d4abdadcdc None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:29.794541 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce5629-0515-4057-93f2-89d4abdadcdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:29.805310 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce5629-0515-4057-93f2-89d4abdadcdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:29.806752 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce5629-0515-4057-93f2-89d4abdadcdc None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-a4ce5629-0515-4057-93f2-89d4abdadcdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:29.822362 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:29.823647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:29.824604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:29.824604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:29.824604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:29.824604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 632/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 14:42:29.829725 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0ff96-4755-4e8c-8be1-64b4ef927b58 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:29.910452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:29.928934 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0ff96-4755-4e8c-8be1-64b4ef927b58 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:29.962100 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26516255-8983-435e-8c15-218ca1d7b556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:29.962694 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26516255-8983-435e-8c15-218ca1d7b556 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:29.962994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26516255-8983-435e-8c15-218ca1d7b556 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:29.963273 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26516255-8983-435e-8c15-218ca1d7b556 None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:29.963904 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26516255-8983-435e-8c15-218ca1d7b556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:29.964207 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26516255-8983-435e-8c15-218ca1d7b556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:29.965541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26516255-8983-435e-8c15-218ca1d7b556 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:29.977210 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 634/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:29.982792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce5629-0515-4057-93f2-89d4abdadcdc None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:30.082053 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce5629-0515-4057-93f2-89d4abdadcdc None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:30.101781 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:30.116378 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804dc8d-4d7d-4670-9589-0c14873841dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:30.116993 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804dc8d-4d7d-4670-9589-0c14873841dd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:30.117269 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804dc8d-4d7d-4670-9589-0c14873841dd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:30.117535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804dc8d-4d7d-4670-9589-0c14873841dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:30.125076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804dc8d-4d7d-4670-9589-0c14873841dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:30.126493 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804dc8d-4d7d-4670-9589-0c14873841dd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-8804dc8d-4d7d-4670-9589-0c14873841dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:42:30.137803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:30.138917 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:30.139915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 633/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:30.144747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26516255-8983-435e-8c15-218ca1d7b556 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:30.238837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26516255-8983-435e-8c15-218ca1d7b556 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:30.272013 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c47eb-4631-426c-9e2a-300a27445d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:30.272599 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c47eb-4631-426c-9e2a-300a27445d76 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:30.272875 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c47eb-4631-426c-9e2a-300a27445d76 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:30.273146 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c47eb-4631-426c-9e2a-300a27445d76 None admin] PATH_INFO: `/v3/users` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:30.273850 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c47eb-4631-426c-9e2a-300a27445d76 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:30.274151 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c47eb-4631-426c-9e2a-300a27445d76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:30.275587 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c47eb-4631-426c-9e2a-300a27445d76 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:30.283858 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:30.292311 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 635/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Oct 3 14:42:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:30.297957 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804dc8d-4d7d-4670-9589-0c14873841dd None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:30.394766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804dc8d-4d7d-4670-9589-0c14873841dd None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:30.427983 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671e00-4b33-4e94-8e71-63b2395116cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:30.428757 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671e00-4b33-4e94-8e71-63b2395116cc None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:30.429440 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671e00-4b33-4e94-8e71-63b2395116cc None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:30.429718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13671e00-4b33-4e94-8e71-63b2395116cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:30.440230 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13671e00-4b33-4e94-8e71-63b2395116cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:30.441807 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13671e00-4b33-4e94-8e71-63b2395116cc None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-13671e00-4b33-4e94-8e71-63b2395116cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:30.456522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:30.457495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:30.458666 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:30.458666 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:30.458666 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:30.458666 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 634/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:30.463351 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c47eb-4631-426c-9e2a-300a27445d76 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:30.566530 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c47eb-4631-426c-9e2a-300a27445d76 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:30.600692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6ac71-2bb2-4dcc-984b-422a0124bb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:30.601290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6ac71-2bb2-4dcc-984b-422a0124bb8f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:30.601566 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6ac71-2bb2-4dcc-984b-422a0124bb8f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:30.601836 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6ac71-2bb2-4dcc-984b-422a0124bb8f None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:30.602458 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6ac71-2bb2-4dcc-984b-422a0124bb8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:30.602754 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6ac71-2bb2-4dcc-984b-422a0124bb8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:30.604127 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6ac71-2bb2-4dcc-984b-422a0124bb8f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:30.615309 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 636/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:30.621194 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671e00-4b33-4e94-8e71-63b2395116cc None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:30.651347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:30.717066 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13671e00-4b33-4e94-8e71-63b2395116cc None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:30.750006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce9b97-f16e-4b7c-9d6e-ce2201188dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:30.750613 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce9b97-f16e-4b7c-9d6e-ce2201188dec None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:30.750893 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce9b97-f16e-4b7c-9d6e-ce2201188dec None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:30.751192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce9b97-f16e-4b7c-9d6e-ce2201188dec None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:30.758142 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce9b97-f16e-4b7c-9d6e-ce2201188dec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:30.759593 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce9b97-f16e-4b7c-9d6e-ce2201188dec None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-76ce9b97-f16e-4b7c-9d6e-ce2201188dec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:42:30.770449 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:30.771588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:30.772783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:42:30.772783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:42:30.772783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:42:30.772783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:42:30.772783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:42:30.772783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:42:30.772783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:30.772783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:30.772783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 635/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:30.777720 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6ac71-2bb2-4dcc-984b-422a0124bb8f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:30.836317 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:30.876976 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6ac71-2bb2-4dcc-984b-422a0124bb8f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:30.908872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac17fa-e5c9-48fd-b818-4af2a0157c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:30.909463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac17fa-e5c9-48fd-b818-4af2a0157c8d None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:30.909740 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac17fa-e5c9-48fd-b818-4af2a0157c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:30.910007 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac17fa-e5c9-48fd-b818-4af2a0157c8d None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:30.910683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac17fa-e5c9-48fd-b818-4af2a0157c8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:30.911005 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac17fa-e5c9-48fd-b818-4af2a0157c8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:30.913069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac17fa-e5c9-48fd-b818-4af2a0157c8d None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:30.924319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 637/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:30.930267 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce9b97-f16e-4b7c-9d6e-ce2201188dec None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:31.017898 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:31.027333 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce9b97-f16e-4b7c-9d6e-ce2201188dec None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:31.059633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aa2aba-59f9-468d-a278-329c553c6b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:31.060270 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2aba-59f9-468d-a278-329c553c6b1d None admin] REQUEST_METHOD: `PUT` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:31.060550 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2aba-59f9-468d-a278-329c553c6b1d None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:31.060824 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aa2aba-59f9-468d-a278-329c553c6b1d None admin] PATH_INFO: `/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/d89b836f341b419dad35887c46d68730/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:31.062644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa2aba-59f9-468d-a278-329c553c6b1d None admin] RBAC: Authorizing `identity:create_grant(project_id=381e0d308a204c05a7713bbf78d599fc, user_id=d89b836f341b419dad35887c46d68730, role_id=9fbfb6f5ad7945098f7c0cd1a791fdb0)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:31.064073 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aa2aba-59f9-468d-a278-329c553c6b1d None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:31.075865 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 636/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Oct 3 14:42:30 2022] PUT /identity/v3/projects/381e0d308a204c05a7713bbf78d599fc/users/d89b836f341b419dad35887c46d68730/roles/9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:42:33.221852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe71e3-649d-4554-a7e9-34640c435df7 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:33.222370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe71e3-649d-4554-a7e9-34640c435df7 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:33.222370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe71e3-649d-4554-a7e9-34640c435df7 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:33.223815 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 638/1274] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:33.229692 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64448-16e9-44df-b325-d469f656e7f5 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:33.230135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64448-16e9-44df-b325-d469f656e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:33.230240 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64448-16e9-44df-b325-d469f656e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:33.248429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-c0b64448-16e9-44df-b325-d469f656e7f5 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:33.249613 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-c0b64448-16e9-44df-b325-d469f656e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:33.314995 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 637/1275] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:33.585398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe71e3-649d-4554-a7e9-34640c435df7 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:33.693726 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe71e3-649d-4554-a7e9-34640c435df7 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:33.710441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:33.728117 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210b091-d47b-4099-afa4-d84156e3acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:33.728732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210b091-d47b-4099-afa4-d84156e3acb1 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:33.729014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210b091-d47b-4099-afa4-d84156e3acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:33.729287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210b091-d47b-4099-afa4-d84156e3acb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:33.739170 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210b091-d47b-4099-afa4-d84156e3acb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-c210b091-d47b-4099-afa4-d84156e3acb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 14:42:33.745051 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:33.746182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:33.747292 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 639/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Oct 3 14:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:33.752226 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64448-16e9-44df-b325-d469f656e7f5 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:33.838804 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:33.857704 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64448-16e9-44df-b325-d469f656e7f5 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:33.890964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67615390-4b55-4e2b-a27d-eb41328128b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:33.891595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67615390-4b55-4e2b-a27d-eb41328128b6 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:33.891876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67615390-4b55-4e2b-a27d-eb41328128b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:33.892151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67615390-4b55-4e2b-a27d-eb41328128b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:33.892813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67615390-4b55-4e2b-a27d-eb41328128b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:33.893138 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67615390-4b55-4e2b-a27d-eb41328128b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:33.894489 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67615390-4b55-4e2b-a27d-eb41328128b6 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:33.903185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 638/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Oct 3 14:42:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:33.908989 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210b091-d47b-4099-afa4-d84156e3acb1 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:34.004753 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210b091-d47b-4099-afa4-d84156e3acb1 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:34.037695 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65ea46-899c-455a-ab80-d870859ed478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:34.038305 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ea46-899c-455a-ab80-d870859ed478 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:34.038584 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ea46-899c-455a-ab80-d870859ed478 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:34.038856 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65ea46-899c-455a-ab80-d870859ed478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:34.048475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65ea46-899c-455a-ab80-d870859ed478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:34.049894 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65ea46-899c-455a-ab80-d870859ed478 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-0f65ea46-899c-455a-ab80-d870859ed478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:34.063955 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:34.065074 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:34.066133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:34.066133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:34.066133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:34.066133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 640/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:34.070892 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67615390-4b55-4e2b-a27d-eb41328128b6 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:34.167264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67615390-4b55-4e2b-a27d-eb41328128b6 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:34.198693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97077cab-1504-40b8-a1a3-c058fee8b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:34.199313 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97077cab-1504-40b8-a1a3-c058fee8b572 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:34.199594 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97077cab-1504-40b8-a1a3-c058fee8b572 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:34.199865 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97077cab-1504-40b8-a1a3-c058fee8b572 None admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:34.200485 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97077cab-1504-40b8-a1a3-c058fee8b572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:34.200783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97077cab-1504-40b8-a1a3-c058fee8b572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:34.202112 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97077cab-1504-40b8-a1a3-c058fee8b572 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:34.213902 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 639/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:34.219745 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65ea46-899c-455a-ab80-d870859ed478 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:34.250046 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:34.319370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65ea46-899c-455a-ab80-d870859ed478 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:34.353295 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71718-9b3a-4ffb-af5f-4328b02c430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:34.353917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71718-9b3a-4ffb-af5f-4328b02c430a None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:34.354197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71718-9b3a-4ffb-af5f-4328b02c430a None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:34.354471 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe71718-9b3a-4ffb-af5f-4328b02c430a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:34.362341 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe71718-9b3a-4ffb-af5f-4328b02c430a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:34.363849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe71718-9b3a-4ffb-af5f-4328b02c430a None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-ffe71718-9b3a-4ffb-af5f-4328b02c430a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 14:42:34.375240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:34.376375 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:34.377501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 641/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:34.383008 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97077cab-1504-40b8-a1a3-c058fee8b572 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:34.386714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:34.491055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97077cab-1504-40b8-a1a3-c058fee8b572 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:34.524314 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aff07-c76f-462a-a90b-022f1851ebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:34.524906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aff07-c76f-462a-a90b-022f1851ebbe None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:34.525183 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aff07-c76f-462a-a90b-022f1851ebbe None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:34.525452 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aff07-c76f-462a-a90b-022f1851ebbe None admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:34.526152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aff07-c76f-462a-a90b-022f1851ebbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:34.526453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aff07-c76f-462a-a90b-022f1851ebbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:34.527874 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aff07-c76f-462a-a90b-022f1851ebbe None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:34.544111 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 640/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Oct 3 14:42:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:34.549852 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71718-9b3a-4ffb-af5f-4328b02c430a None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:34.638452 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:34.648744 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe71718-9b3a-4ffb-af5f-4328b02c430a None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:34.681174 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ced5a3-83ed-4388-864f-21c21b2fd2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:34.681773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ced5a3-83ed-4388-864f-21c21b2fd2b7 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:34.682052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ced5a3-83ed-4388-864f-21c21b2fd2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:34.682324 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ced5a3-83ed-4388-864f-21c21b2fd2b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:34.749419 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ced5a3-83ed-4388-864f-21c21b2fd2b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:34.750759 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ced5a3-83ed-4388-864f-21c21b2fd2b7 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:34.836179 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:34.846295 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 642/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Oct 3 14:42:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 14:42:34.853139 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aff07-c76f-462a-a90b-022f1851ebbe None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:34.912968 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:34.950725 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aff07-c76f-462a-a90b-022f1851ebbe None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:34.984023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71170065-5fad-46c3-b578-0189e5adb4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:34.984641 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71170065-5fad-46c3-b578-0189e5adb4aa None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:34.984922 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71170065-5fad-46c3-b578-0189e5adb4aa None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:34.985206 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71170065-5fad-46c3-b578-0189e5adb4aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:34.995350 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71170065-5fad-46c3-b578-0189e5adb4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:34.996787 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71170065-5fad-46c3-b578-0189e5adb4aa None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-71170065-5fad-46c3-b578-0189e5adb4aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 14:42:35.011457 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:35.012642 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 14:42:35.013719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 14:42:35.013719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 14:42:35.013719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:35.013719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 641/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:35.018129 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ced5a3-83ed-4388-864f-21c21b2fd2b7 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:35.116732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ced5a3-83ed-4388-864f-21c21b2fd2b7 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:35.150505 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d59c0-3481-45fd-b6de-46231c91490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:35.151134 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d59c0-3481-45fd-b6de-46231c91490f None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:35.151421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d59c0-3481-45fd-b6de-46231c91490f None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:35.151692 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d59c0-3481-45fd-b6de-46231c91490f None admin] PATH_INFO: `/v3/domains` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:35.152319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d59c0-3481-45fd-b6de-46231c91490f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:35.152620 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d59c0-3481-45fd-b6de-46231c91490f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:35.153954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d59c0-3481-45fd-b6de-46231c91490f None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:35.164936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 643/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Oct 3 14:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:35.170586 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71170065-5fad-46c3-b578-0189e5adb4aa None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:35.265788 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71170065-5fad-46c3-b578-0189e5adb4aa None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:35.279217 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:35.298595 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b5c1e-4d3c-4db3-9aeb-720b9104361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:35.299249 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5c1e-4d3c-4db3-9aeb-720b9104361e None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:35.299528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5c1e-4d3c-4db3-9aeb-720b9104361e None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:35.299800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5c1e-4d3c-4db3-9aeb-720b9104361e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:35.306655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b5c1e-4d3c-4db3-9aeb-720b9104361e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:35.308101 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b5c1e-4d3c-4db3-9aeb-720b9104361e None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application [None req-2b6b5c1e-4d3c-4db3-9aeb-720b9104361e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 14:42:35.319506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:35.320545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:35.321513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 14:42:35.321513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 14:42:35.321513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 14:42:35.321513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 14:42:35.321513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 14:42:35.321513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 14:42:35.321513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 14:42:35.321513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: ERROR keystone.server.flask.application Oct 03 14:42:35.321513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 642/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Oct 3 14:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:35.326332 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d59c0-3481-45fd-b6de-46231c91490f None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:35.375942 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:35.427345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d59c0-3481-45fd-b6de-46231c91490f None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:35.460033 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed87ba-281b-40fb-86d9-bc735b223dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:35.460635 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed87ba-281b-40fb-86d9-bc735b223dc4 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:35.460917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed87ba-281b-40fb-86d9-bc735b223dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:35.461192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed87ba-281b-40fb-86d9-bc735b223dc4 None admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:35.461872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed87ba-281b-40fb-86d9-bc735b223dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:35.462179 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed87ba-281b-40fb-86d9-bc735b223dc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:35.463622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed87ba-281b-40fb-86d9-bc735b223dc4 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:35.475181 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 644/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Oct 3 14:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:35.481255 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b5c1e-4d3c-4db3-9aeb-720b9104361e None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:35.579071 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b5c1e-4d3c-4db3-9aeb-720b9104361e None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:35.611425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53123450-d884-4cab-91a1-a031ae1f4222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:35.612015 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123450-d884-4cab-91a1-a031ae1f4222 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:35.612299 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123450-d884-4cab-91a1-a031ae1f4222 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:35.612573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53123450-d884-4cab-91a1-a031ae1f4222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:35.613286 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53123450-d884-4cab-91a1-a031ae1f4222 None admin] RBAC: Adding query filter params (role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0, scope.project.id=381e0d308a204c05a7713bbf78d599fc, user.id=d89b836f341b419dad35887c46d68730) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:35.613596 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53123450-d884-4cab-91a1-a031ae1f4222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:35.615600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53123450-d884-4cab-91a1-a031ae1f4222 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:35.621428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 643/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Oct 3 14:42:35 2022] GET /identity/v3/role_assignments?user.id=d89b836f341b419dad35887c46d68730&scope.project.id=381e0d308a204c05a7713bbf78d599fc&role.id=9fbfb6f5ad7945098f7c0cd1a791fdb0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:37.787046 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8bcff-3597-49cd-b06f-a9a29dded4cb None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:37.787797 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8bcff-3597-49cd-b06f-a9a29dded4cb None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:37.787797 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8bcff-3597-49cd-b06f-a9a29dded4cb None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:37.789131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 645/1288] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:37.794816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e0acd-9da9-42ea-88ff-11b666da7004 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:37.795267 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e0acd-9da9-42ea-88ff-11b666da7004 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:37.795491 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e0acd-9da9-42ea-88ff-11b666da7004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:37.817215 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a00e0acd-9da9-42ea-88ff-11b666da7004 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:37.818676 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a00e0acd-9da9-42ea-88ff-11b666da7004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:37.853374 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:37.889924 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 644/1289] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:38.159388 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8bcff-3597-49cd-b06f-a9a29dded4cb None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:38.259737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8bcff-3597-49cd-b06f-a9a29dded4cb None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:38.271222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:38.293905 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fee7c-4fe2-4c03-9722-c76b9da7f735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:38.294522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fee7c-4fe2-4c03-9722-c76b9da7f735 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:38.294800 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fee7c-4fe2-4c03-9722-c76b9da7f735 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:38.295107 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fee7c-4fe2-4c03-9722-c76b9da7f735 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:38.295676 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fee7c-4fe2-4c03-9722-c76b9da7f735 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:38.297022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fee7c-4fe2-4c03-9722-c76b9da7f735 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-e72fee7c-4fe2-4c03-9722-c76b9da7f735 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:38.306321 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:38.307506 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:38.308719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 646/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:42:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:38.313275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e0acd-9da9-42ea-88ff-11b666da7004 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:38.408275 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e0acd-9da9-42ea-88ff-11b666da7004 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:38.441491 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507d6c3-070c-47f9-a01d-93b654a438dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:38.442088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507d6c3-070c-47f9-a01d-93b654a438dd None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:38.443070 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507d6c3-070c-47f9-a01d-93b654a438dd None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:38.443366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507d6c3-070c-47f9-a01d-93b654a438dd None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:38.443986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507d6c3-070c-47f9-a01d-93b654a438dd None admin] RBAC: Adding query filter params (name=placement) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:38.444288 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507d6c3-070c-47f9-a01d-93b654a438dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:38.445630 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507d6c3-070c-47f9-a01d-93b654a438dd None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:38.450363 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 645/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Oct 3 14:42:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:38.455981 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fee7c-4fe2-4c03-9722-c76b9da7f735 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:38.554473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fee7c-4fe2-4c03-9722-c76b9da7f735 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:38.587023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcf845-f527-407c-832b-efcabf7f5a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:38.587611 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcf845-f527-407c-832b-efcabf7f5a21 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:38.587892 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcf845-f527-407c-832b-efcabf7f5a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:38.588167 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcf845-f527-407c-832b-efcabf7f5a21 None admin] PATH_INFO: `/v3/services` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:38.588778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcf845-f527-407c-832b-efcabf7f5a21 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:38.589079 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcf845-f527-407c-832b-efcabf7f5a21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:38.590415 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcf845-f527-407c-832b-efcabf7f5a21 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:38.594627 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 647/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Oct 3 14:42:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:40.722021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6956c7e-edf4-49ff-b256-d08ea9aaa0f5 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:40.722569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6956c7e-edf4-49ff-b256-d08ea9aaa0f5 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:40.722569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6956c7e-edf4-49ff-b256-d08ea9aaa0f5 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:40.723950 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 646/1293] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:40.729718 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57edf39-dd8a-4e63-be6f-00383cb1f89a None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:40.730133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57edf39-dd8a-4e63-be6f-00383cb1f89a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:40.730251 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57edf39-dd8a-4e63-be6f-00383cb1f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:40.748792 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-c57edf39-dd8a-4e63-be6f-00383cb1f89a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:40.749953 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-c57edf39-dd8a-4e63-be6f-00383cb1f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:40.781610 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:40.818431 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 648/1294] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:41.084790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6956c7e-edf4-49ff-b256-d08ea9aaa0f5 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:41.116185 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:41.183585 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6956c7e-edf4-49ff-b256-d08ea9aaa0f5 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:41.216088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9784dab-7465-4c9c-900d-85b3a6e4ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:41.216676 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784dab-7465-4c9c-900d-85b3a6e4ec59 None admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:41.216955 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784dab-7465-4c9c-900d-85b3a6e4ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:41.217228 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9784dab-7465-4c9c-900d-85b3a6e4ec59 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:41.217864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9784dab-7465-4c9c-900d-85b3a6e4ec59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:41.219238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9784dab-7465-4c9c-900d-85b3a6e4ec59 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:41.233480 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 647/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Oct 3 14:42:41 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:42:43.363685 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25fe49-7001-48f3-9d67-722f0b6413ce None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:43.364191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25fe49-7001-48f3-9d67-722f0b6413ce None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:43.364191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25fe49-7001-48f3-9d67-722f0b6413ce None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:43.365526 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 649/1296] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:43.370863 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab497cf-aa4f-410c-a930-97ac802bf941 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:43.371326 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab497cf-aa4f-410c-a930-97ac802bf941 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:43.371433 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab497cf-aa4f-410c-a930-97ac802bf941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:43.389653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-1ab497cf-aa4f-410c-a930-97ac802bf941 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:43.390830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-1ab497cf-aa4f-410c-a930-97ac802bf941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:43.461036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 648/1297] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:43.731100 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25fe49-7001-48f3-9d67-722f0b6413ce None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:43.848476 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25fe49-7001-48f3-9d67-722f0b6413ce None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:43.881747 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb18dd-e6da-4fa4-a935-9da629c07606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:43.882359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb18dd-e6da-4fa4-a935-9da629c07606 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:43.882636 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb18dd-e6da-4fa4-a935-9da629c07606 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:43.882907 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb18dd-e6da-4fa4-a935-9da629c07606 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:43.883503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb18dd-e6da-4fa4-a935-9da629c07606 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:43.884840 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb18dd-e6da-4fa4-a935-9da629c07606 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-6edb18dd-e6da-4fa4-a935-9da629c07606 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:43.893198 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:43.894331 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:43.895683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 650/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:42:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:43.900552 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab497cf-aa4f-410c-a930-97ac802bf941 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:43.918525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:43.999851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab497cf-aa4f-410c-a930-97ac802bf941 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:44.033319 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b70d0-3e9e-42c8-9897-38eea396d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:44.033918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b70d0-3e9e-42c8-9897-38eea396d077 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:44.034199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b70d0-3e9e-42c8-9897-38eea396d077 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:44.034474 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b70d0-3e9e-42c8-9897-38eea396d077 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:44.035117 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b70d0-3e9e-42c8-9897-38eea396d077 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:44.035421 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b70d0-3e9e-42c8-9897-38eea396d077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:44.037729 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b70d0-3e9e-42c8-9897-38eea396d077 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:44.042655 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 649/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Oct 3 14:42:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:44.048794 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb18dd-e6da-4fa4-a935-9da629c07606 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:44.080441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:44.148683 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb18dd-e6da-4fa4-a935-9da629c07606 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:44.181512 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161a00f-b113-4f37-9b34-e862c2a9141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:44.182109 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a00f-b113-4f37-9b34-e862c2a9141b None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:44.182392 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a00f-b113-4f37-9b34-e862c2a9141b None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:44.182667 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a00f-b113-4f37-9b34-e862c2a9141b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:44.183386 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161a00f-b113-4f37-9b34-e862c2a9141b None admin] RBAC: Adding query filter params (interface=public, service_id=8978cef1b57b4ffdb3633566ef40d002, region_id=RegionOne) {{(pid=87857) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:44.183696 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161a00f-b113-4f37-9b34-e862c2a9141b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:44.185043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161a00f-b113-4f37-9b34-e862c2a9141b None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:44.191770 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 651/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Oct 3 14:42:44 2022] GET /identity/v3/endpoints?service_id=8978cef1b57b4ffdb3633566ef40d002&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:44.197471 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b70d0-3e9e-42c8-9897-38eea396d077 None admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:44.276381 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:44.294532 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b70d0-3e9e-42c8-9897-38eea396d077 None admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:44.326591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e637c25-2555-49b3-a640-788f8b047227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:44.327214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e637c25-2555-49b3-a640-788f8b047227 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:44.327498 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e637c25-2555-49b3-a640-788f8b047227 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:44.327774 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e637c25-2555-49b3-a640-788f8b047227 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:44.328368 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e637c25-2555-49b3-a640-788f8b047227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:44.329706 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e637c25-2555-49b3-a640-788f8b047227 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:44.336816 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 650/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Oct 3 14:42:44 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 14:42:46.488637 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8920599-2361-4936-8856-1c7e900a1f92 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:46.489657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8920599-2361-4936-8856-1c7e900a1f92 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:46.489849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8920599-2361-4936-8856-1c7e900a1f92 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:46.491238 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 652/1302] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:42:46.496573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ea01-2d68-4298-ac5c-cec80dccdd94 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:46.496938 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ea01-2d68-4298-ac5c-cec80dccdd94 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:46.497130 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ea01-2d68-4298-ac5c-cec80dccdd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:46.514809 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-0697ea01-2d68-4298-ac5c-cec80dccdd94 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:42:46.516019 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-0697ea01-2d68-4298-ac5c-cec80dccdd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:42:46.579631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 651/1303] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:42:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 14:42:46.849057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8920599-2361-4936-8856-1c7e900a1f92 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:46.941290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:46.948821 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8920599-2361-4936-8856-1c7e900a1f92 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:46.981899 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013263d6-27e2-4847-84bd-7ee9a9839f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:46.982514 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013263d6-27e2-4847-84bd-7ee9a9839f78 None admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:46.982798 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013263d6-27e2-4847-84bd-7ee9a9839f78 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:46.983105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013263d6-27e2-4847-84bd-7ee9a9839f78 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:46.983682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013263d6-27e2-4847-84bd-7ee9a9839f78 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:46.985021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013263d6-27e2-4847-84bd-7ee9a9839f78 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application [None req-013263d6-27e2-4847-84bd-7ee9a9839f78 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 14:42:46.994064 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 14:42:46.995236 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application with Lock( Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self._enter() Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application return self.creator() Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application created_value = creator( Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: ERROR keystone.server.flask.application Oct 03 14:42:46.996531 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 653/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Oct 3 14:42:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 14:42:47.001088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697ea01-2d68-4298-ac5c-cec80dccdd94 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:47.074436 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:47.097420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697ea01-2d68-4298-ac5c-cec80dccdd94 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:47.131294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d728fcc-9ad7-4432-93a2-82c76227c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:47.131835 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d728fcc-9ad7-4432-93a2-82c76227c678 None admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:47.132120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d728fcc-9ad7-4432-93a2-82c76227c678 None admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:47.132396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d728fcc-9ad7-4432-93a2-82c76227c678 None admin] PATH_INFO: `/v3/services` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:47.136893 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d728fcc-9ad7-4432-93a2-82c76227c678 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:42:47.137217 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d728fcc-9ad7-4432-93a2-82c76227c678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:47.138587 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d728fcc-9ad7-4432-93a2-82c76227c678 None admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:47.143675 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 652/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Oct 3 14:42:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:42:47.149539 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013263d6-27e2-4847-84bd-7ee9a9839f78 None admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:42:47.246024 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013263d6-27e2-4847-84bd-7ee9a9839f78 None admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:42:47.277097 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13f520-15aa-4431-b57b-46866ee3fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:42:47.277681 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13f520-15aa-4431-b57b-46866ee3fe60 None admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:42:47.277957 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13f520-15aa-4431-b57b-46866ee3fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:42:47.278225 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13f520-15aa-4431-b57b-46866ee3fe60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:42:47.278878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13f520-15aa-4431-b57b-46866ee3fe60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:42:47.280241 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13f520-15aa-4431-b57b-46866ee3fe60 None admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:42:47.299021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 654/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:42:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 14:42:57.140743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=30 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:42:57.294826 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:51.360012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e117-11c6-4c53-a915-1e634f1e9a9c None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:51.360473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e117-11c6-4c53-a915-1e634f1e9a9c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:51.360571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2e117-11c6-4c53-a915-1e634f1e9a9c None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:51.362485 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 653/1307] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:43:51.368092 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25522f0-b631-48e3-8299-ded79087eab8 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:51.368473 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25522f0-b631-48e3-8299-ded79087eab8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:51.368552 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25522f0-b631-48e3-8299-ded79087eab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:51.543527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-e25522f0-b631-48e3-8299-ded79087eab8 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:43:51.544725 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-e25522f0-b631-48e3-8299-ded79087eab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:51.758394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 655/1308] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:43:52.060405 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ed84-c1d9-4fb9-8896-dec607eb1fc6 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:52.060967 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ed84-c1d9-4fb9-8896-dec607eb1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:52.061393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ed84-c1d9-4fb9-8896-dec607eb1fc6 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:52.062975 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 654/1309] 10.222.0.39 () {54 vars in 964 bytes} [Mon Oct 3 14:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:43:52.069891 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444b7e-c51d-4ba7-a472-2add9f835aaf None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:52.070281 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444b7e-c51d-4ba7-a472-2add9f835aaf None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:52.070632 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444b7e-c51d-4ba7-a472-2add9f835aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:52.186276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-19444b7e-c51d-4ba7-a472-2add9f835aaf None None] MFA Rules not processed for user `0561a97f1a4d4f469cb5c2103e2541f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:43:52.187714 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-19444b7e-c51d-4ba7-a472-2add9f835aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:52.216110 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:52.296795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 656/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Oct 3 14:43:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:43:52.297554 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7ed84-c1d9-4fb9-8896-dec607eb1fc6 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:43:52.299876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-fff7ed84-c1d9-4fb9-8896-dec607eb1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:52.421072 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7ed84-c1d9-4fb9-8896-dec607eb1fc6 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:43:52.508490 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b829831-e9db-4d79-84c4-4a346a6ee01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:43:52.509565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829831-e9db-4d79-84c4-4a346a6ee01a service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:52.510124 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829831-e9db-4d79-84c4-4a346a6ee01a service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:52.510672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829831-e9db-4d79-84c4-4a346a6ee01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:52.512622 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-1b829831-e9db-4d79-84c4-4a346a6ee01a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:52.582123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:52.651026 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b829831-e9db-4d79-84c4-4a346a6ee01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:43:52.652596 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b829831-e9db-4d79-84c4-4a346a6ee01a service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:43:52.672784 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 655/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:43:55.146063 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f290a-1de6-4bb9-80c9-ff522a34f208 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:55.146573 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f290a-1de6-4bb9-80c9-ff522a34f208 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:55.146670 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f290a-1de6-4bb9-80c9-ff522a34f208 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:55.147962 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 657/1312] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:43:55.153290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8234fc-2d8e-401d-bb1d-aed85a5d371e None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:55.153723 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8234fc-2d8e-401d-bb1d-aed85a5d371e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:55.153851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8234fc-2d8e-401d-bb1d-aed85a5d371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:55.224419 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-9b8234fc-2d8e-401d-bb1d-aed85a5d371e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:43:55.225561 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-9b8234fc-2d8e-401d-bb1d-aed85a5d371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:55.318305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 656/1313] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:43:55.611038 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f290a-1de6-4bb9-80c9-ff522a34f208 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:43:55.612755 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-5f2f290a-1de6-4bb9-80c9-ff522a34f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:55.716192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f290a-1de6-4bb9-80c9-ff522a34f208 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:43:55.785772 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:55.787761 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ac340-6a85-42bf-89ff-f8d8a698055f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:43:55.788367 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ac340-6a85-42bf-89ff-f8d8a698055f service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:55.788821 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ac340-6a85-42bf-89ff-f8d8a698055f service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:55.789319 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ac340-6a85-42bf-89ff-f8d8a698055f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:55.791176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-b58ac340-6a85-42bf-89ff-f8d8a698055f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:55.901562 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ac340-6a85-42bf-89ff-f8d8a698055f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:43:55.902910 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ac340-6a85-42bf-89ff-f8d8a698055f service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:43:55.921827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 658/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:43:58.381898 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26f090-7c48-40c8-973f-b71d9d2a7253 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:58.382407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26f090-7c48-40c8-973f-b71d9d2a7253 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:58.382407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26f090-7c48-40c8-973f-b71d9d2a7253 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:58.383731 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 657/1315] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:43:58.389086 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c0cd2-d6fc-42ea-8397-4694e7abf539 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:58.389486 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c0cd2-d6fc-42ea-8397-4694e7abf539 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:58.389637 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c0cd2-d6fc-42ea-8397-4694e7abf539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:58.458173 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-7f5c0cd2-d6fc-42ea-8397-4694e7abf539 None None] MFA Rules not processed for user `c23d5a581fbf45b78bcf03fdbfb9ff89`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:43:58.459411 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-7f5c0cd2-d6fc-42ea-8397-4694e7abf539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:58.511611 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:58.556406 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 659/1316] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:43:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:43:58.845309 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26f090-7c48-40c8-973f-b71d9d2a7253 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:43:58.846985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-ae26f090-7c48-40c8-973f-b71d9d2a7253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:58.858573 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:58.951676 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26f090-7c48-40c8-973f-b71d9d2a7253 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:43:59.023023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb007b6d-1f0c-43ee-9e48-6d42cdeeaff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:43:59.023627 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb007b6d-1f0c-43ee-9e48-6d42cdeeaff9 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:43:59.023905 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb007b6d-1f0c-43ee-9e48-6d42cdeeaff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:43:59.024182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb007b6d-1f0c-43ee-9e48-6d42cdeeaff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:43:59.025735 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-cb007b6d-1f0c-43ee-9e48-6d42cdeeaff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:43:59.086692 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:43:59.133799 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb007b6d-1f0c-43ee-9e48-6d42cdeeaff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:43:59.135207 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb007b6d-1f0c-43ee-9e48-6d42cdeeaff9 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:43:59.152929 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 658/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:43:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:01.852095 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb835832-0c3b-43a8-b873-4669108f4990 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:01.852631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb835832-0c3b-43a8-b873-4669108f4990 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:01.852631 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb835832-0c3b-43a8-b873-4669108f4990 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:01.854025 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 660/1318] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:01.859306 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac3a92-f8ac-4b46-b21d-835b313ca109 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:01.859721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac3a92-f8ac-4b46-b21d-835b313ca109 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:01.859863 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac3a92-f8ac-4b46-b21d-835b313ca109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:01.924739 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-23ac3a92-f8ac-4b46-b21d-835b313ca109 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:01.925924 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-23ac3a92-f8ac-4b46-b21d-835b313ca109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:02.019893 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 659/1319] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:02.302793 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb835832-0c3b-43a8-b873-4669108f4990 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:02.304374 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-eb835832-0c3b-43a8-b873-4669108f4990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:02.404370 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb835832-0c3b-43a8-b873-4669108f4990 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:02.477071 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6607e-aa8b-4268-8457-737cf1c6c5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:02.477672 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6607e-aa8b-4268-8457-737cf1c6c5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:02.477949 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6607e-aa8b-4268-8457-737cf1c6c5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:02.478218 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6607e-aa8b-4268-8457-737cf1c6c5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:02.479819 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-06a6607e-aa8b-4268-8457-737cf1c6c5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:02.486782 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:02.586633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6607e-aa8b-4268-8457-737cf1c6c5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:02.588153 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6607e-aa8b-4268-8457-737cf1c6c5a5 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:02.605839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 661/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:05.426131 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304476bd-e592-435b-9f44-a7fef6798e18 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:05.426700 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304476bd-e592-435b-9f44-a7fef6798e18 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:05.426700 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304476bd-e592-435b-9f44-a7fef6798e18 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:05.428081 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 660/1321] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:05.434176 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9d6dd-14cf-40d9-ba6a-c2d6ebe608cb None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:05.434601 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9d6dd-14cf-40d9-ba6a-c2d6ebe608cb None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:05.434722 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9d6dd-14cf-40d9-ba6a-c2d6ebe608cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:05.507187 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-c5d9d6dd-14cf-40d9-ba6a-c2d6ebe608cb None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:05.508425 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-c5d9d6dd-14cf-40d9-ba6a-c2d6ebe608cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:05.575937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:05.618920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 662/1322] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:05.919491 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d206-6d0f-4959-bf68-d632019a6961 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:05.919885 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d206-6d0f-4959-bf68-d632019a6961 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:05.920226 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d206-6d0f-4959-bf68-d632019a6961 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:05.921666 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 661/1323] 10.222.0.39 () {54 vars in 964 bytes} [Mon Oct 3 14:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:05.929615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f410f57-f339-4a92-bcca-a42ab94b2ff2 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:05.929992 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f410f57-f339-4a92-bcca-a42ab94b2ff2 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:05.930368 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f410f57-f339-4a92-bcca-a42ab94b2ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:06.006466 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-9f410f57-f339-4a92-bcca-a42ab94b2ff2 None None] MFA Rules not processed for user `0561a97f1a4d4f469cb5c2103e2541f3`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:06.007701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-9f410f57-f339-4a92-bcca-a42ab94b2ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:06.083776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 663/1324] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Oct 3 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:06.097284 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d206-6d0f-4959-bf68-d632019a6961 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:06.098818 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-da36d206-6d0f-4959-bf68-d632019a6961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:06.120291 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:06.207696 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d206-6d0f-4959-bf68-d632019a6961 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:06.285483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce6001-1071-4cd1-82ab-25d50749fb26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:06.286094 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce6001-1071-4cd1-82ab-25d50749fb26 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:06.286378 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce6001-1071-4cd1-82ab-25d50749fb26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:06.286654 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce6001-1071-4cd1-82ab-25d50749fb26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:06.288288 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-d8ce6001-1071-4cd1-82ab-25d50749fb26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:06.365037 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:06.403494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce6001-1071-4cd1-82ab-25d50749fb26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:06.404901 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce6001-1071-4cd1-82ab-25d50749fb26 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:06.423670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 662/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:08.920225 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875f6e3-d4d2-407d-b068-614b0869ab54 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:08.920754 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875f6e3-d4d2-407d-b068-614b0869ab54 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:08.920754 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875f6e3-d4d2-407d-b068-614b0869ab54 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:08.922069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 664/1326] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:08.928091 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89a38-8f71-429e-a57a-386dd7c88bef None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:08.928542 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89a38-8f71-429e-a57a-386dd7c88bef None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:08.928651 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89a38-8f71-429e-a57a-386dd7c88bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:08.995571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-a4d89a38-8f71-429e-a57a-386dd7c88bef None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:08.996769 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a4d89a38-8f71-429e-a57a-386dd7c88bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:09.095420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 663/1327] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:09.383353 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875f6e3-d4d2-407d-b068-614b0869ab54 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:09.384871 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-e875f6e3-d4d2-407d-b068-614b0869ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:09.451387 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:09.495901 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875f6e3-d4d2-407d-b068-614b0869ab54 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:09.571046 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6909e85-ae2f-422f-b5ec-5d3da972cb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:09.571661 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6909e85-ae2f-422f-b5ec-5d3da972cb30 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:09.571936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6909e85-ae2f-422f-b5ec-5d3da972cb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:09.572209 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6909e85-ae2f-422f-b5ec-5d3da972cb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:09.573776 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-a6909e85-ae2f-422f-b5ec-5d3da972cb30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:09.682544 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:09.684841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6909e85-ae2f-422f-b5ec-5d3da972cb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:09.686781 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6909e85-ae2f-422f-b5ec-5d3da972cb30 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:09.710177 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 665/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:11.958064 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff65c4-4b4f-4773-aa9d-7d510f5dd891 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:11.958588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff65c4-4b4f-4773-aa9d-7d510f5dd891 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:11.958588 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff65c4-4b4f-4773-aa9d-7d510f5dd891 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:11.960001 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 664/1329] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:11.965399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4b1ad-3db8-4f4f-80af-c2d9c197f729 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:11.965834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4b1ad-3db8-4f4f-80af-c2d9c197f729 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:11.965946 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4b1ad-3db8-4f4f-80af-c2d9c197f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:12.035634 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-d8a4b1ad-3db8-4f4f-80af-c2d9c197f729 None None] MFA Rules not processed for user `c23d5a581fbf45b78bcf03fdbfb9ff89`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:12.036842 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-d8a4b1ad-3db8-4f4f-80af-c2d9c197f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:12.139121 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 666/1330] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:12.423033 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff65c4-4b4f-4773-aa9d-7d510f5dd891 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:12.424897 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-1aff65c4-4b4f-4773-aa9d-7d510f5dd891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:12.456428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:12.534820 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff65c4-4b4f-4773-aa9d-7d510f5dd891 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:12.611899 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c543f65-a546-45f6-a835-9342678651c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:12.612526 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c543f65-a546-45f6-a835-9342678651c7 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:12.612812 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c543f65-a546-45f6-a835-9342678651c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:12.613089 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c543f65-a546-45f6-a835-9342678651c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:12.615941 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-2c543f65-a546-45f6-a835-9342678651c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:12.699790 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:12.737591 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c543f65-a546-45f6-a835-9342678651c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:12.738941 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c543f65-a546-45f6-a835-9342678651c7 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:12.758849 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 665/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:15.183102 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8832d-f9d8-4b88-ae31-6a779e484211 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:15.183654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8832d-f9d8-4b88-ae31-6a779e484211 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:15.183654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8832d-f9d8-4b88-ae31-6a779e484211 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:15.184986 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 667/1332] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:15.190255 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bcec6-fa34-4180-a310-2a11b64d455e None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:15.190684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bcec6-fa34-4180-a310-2a11b64d455e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:15.190795 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bcec6-fa34-4180-a310-2a11b64d455e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:15.256223 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-ee9bcec6-fa34-4180-a310-2a11b64d455e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:15.257347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-ee9bcec6-fa34-4180-a310-2a11b64d455e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:15.352221 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 666/1333] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:15.633600 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8832d-f9d8-4b88-ae31-6a779e484211 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:15.635155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-5db8832d-f9d8-4b88-ae31-6a779e484211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:15.704453 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:15.738590 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8832d-f9d8-4b88-ae31-6a779e484211 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:15.810165 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf15943-f110-4b93-b189-3d523df0df08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:15.810766 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15943-f110-4b93-b189-3d523df0df08 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:15.811073 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15943-f110-4b93-b189-3d523df0df08 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:15.811345 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15943-f110-4b93-b189-3d523df0df08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:15.813021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-2cf15943-f110-4b93-b189-3d523df0df08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:15.918674 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf15943-f110-4b93-b189-3d523df0df08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:15.920030 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf15943-f110-4b93-b189-3d523df0df08 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:15.929970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:15.938615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 668/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:18.169691 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535f4f-559c-4685-9013-1cd5c0f1a5b9 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:18.170243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535f4f-559c-4685-9013-1cd5c0f1a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:18.170243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535f4f-559c-4685-9013-1cd5c0f1a5b9 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:18.171610 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 667/1335] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:18.177229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cbd5-e1af-4a47-8c88-179e92097aff None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:18.177694 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cbd5-e1af-4a47-8c88-179e92097aff None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:18.177801 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cbd5-e1af-4a47-8c88-179e92097aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:18.244133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-1296cbd5-e1af-4a47-8c88-179e92097aff None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:18.245247 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-1296cbd5-e1af-4a47-8c88-179e92097aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:18.339427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 669/1336] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:18.625742 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535f4f-559c-4685-9013-1cd5c0f1a5b9 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:18.627304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-fe535f4f-559c-4685-9013-1cd5c0f1a5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:18.666758 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:18.729214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535f4f-559c-4685-9013-1cd5c0f1a5b9 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:18.804379 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800e42c-0921-48d3-8cab-6fedaf3d0bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:18.804985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800e42c-0921-48d3-8cab-6fedaf3d0bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:18.805266 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800e42c-0921-48d3-8cab-6fedaf3d0bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:18.805541 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800e42c-0921-48d3-8cab-6fedaf3d0bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:18.807159 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-e800e42c-0921-48d3-8cab-6fedaf3d0bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:18.891481 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:18.916837 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800e42c-0921-48d3-8cab-6fedaf3d0bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:18.918264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800e42c-0921-48d3-8cab-6fedaf3d0bc2 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:18.935598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 668/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:21.408371 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e16d09-79ee-4316-b149-04fc35523306 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:21.408931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e16d09-79ee-4316-b149-04fc35523306 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:21.408931 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e16d09-79ee-4316-b149-04fc35523306 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:21.410267 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 670/1338] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:21.415569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241f5a4-36d1-483a-a116-8856771e4d72 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:21.415948 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241f5a4-36d1-483a-a116-8856771e4d72 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:21.416117 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241f5a4-36d1-483a-a116-8856771e4d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:21.480576 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-7241f5a4-36d1-483a-a116-8856771e4d72 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:21.481760 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-7241f5a4-36d1-483a-a116-8856771e4d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:21.580495 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 669/1339] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:21.867304 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e16d09-79ee-4316-b149-04fc35523306 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:21.868979 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-79e16d09-79ee-4316-b149-04fc35523306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:21.943445 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:21.971662 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e16d09-79ee-4316-b149-04fc35523306 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:22.043606 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efbdb4-f44f-4a32-9e59-85fdd8eb6159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:22.044183 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efbdb4-f44f-4a32-9e59-85fdd8eb6159 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:22.044463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efbdb4-f44f-4a32-9e59-85fdd8eb6159 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:22.044734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efbdb4-f44f-4a32-9e59-85fdd8eb6159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:22.046280 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-a9efbdb4-f44f-4a32-9e59-85fdd8eb6159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:22.159397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efbdb4-f44f-4a32-9e59-85fdd8eb6159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:22.161022 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efbdb4-f44f-4a32-9e59-85fdd8eb6159 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:22.179247 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 671/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:26.279042 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb6f7c-2014-49d7-a4dd-aef91b927ca5 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:26.279568 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb6f7c-2014-49d7-a4dd-aef91b927ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:26.279682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb6f7c-2014-49d7-a4dd-aef91b927ca5 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:26.281115 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 670/1341] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:26.286381 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e019b6-ca21-45e7-a3b4-a09cba1ac712 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:26.286806 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e019b6-ca21-45e7-a3b4-a09cba1ac712 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:26.286992 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e019b6-ca21-45e7-a3b4-a09cba1ac712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:26.292469 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:26.356898 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-e2e019b6-ca21-45e7-a3b4-a09cba1ac712 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:26.358094 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-e2e019b6-ca21-45e7-a3b4-a09cba1ac712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:26.456445 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 672/1342] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:26.750826 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb6f7c-2014-49d7-a4dd-aef91b927ca5 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:26.752405 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-4aeb6f7c-2014-49d7-a4dd-aef91b927ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:26.802546 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:26.857125 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb6f7c-2014-49d7-a4dd-aef91b927ca5 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:26.940575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e835f6-a85a-43f0-b80b-142161fd205d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:26.941179 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e835f6-a85a-43f0-b80b-142161fd205d service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:26.941456 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e835f6-a85a-43f0-b80b-142161fd205d service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:26.941724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e835f6-a85a-43f0-b80b-142161fd205d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:26.943317 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-83e835f6-a85a-43f0-b80b-142161fd205d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:27.036779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:27.053657 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e835f6-a85a-43f0-b80b-142161fd205d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:27.055141 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e835f6-a85a-43f0-b80b-142161fd205d service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:27.073401 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 671/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:30.282834 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98864c-0c2a-4c52-bdb7-2f3dc94ed147 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:30.283455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98864c-0c2a-4c52-bdb7-2f3dc94ed147 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:30.283455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98864c-0c2a-4c52-bdb7-2f3dc94ed147 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:30.284773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 673/1344] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:30.290273 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfac0d-7750-49d3-bf09-69921ecd25e4 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:30.290739 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfac0d-7750-49d3-bf09-69921ecd25e4 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:30.290843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfac0d-7750-49d3-bf09-69921ecd25e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:30.358051 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-8adfac0d-7750-49d3-bf09-69921ecd25e4 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:30.359907 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-8adfac0d-7750-49d3-bf09-69921ecd25e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:30.460371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 672/1345] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:30.745793 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98864c-0c2a-4c52-bdb7-2f3dc94ed147 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:30.747427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-1a98864c-0c2a-4c52-bdb7-2f3dc94ed147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:30.841329 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:30.860737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98864c-0c2a-4c52-bdb7-2f3dc94ed147 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:30.954273 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a6357-75d3-477e-b8d3-27e6b96bb23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:30.954884 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a6357-75d3-477e-b8d3-27e6b96bb23e service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:30.955195 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a6357-75d3-477e-b8d3-27e6b96bb23e service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:30.955466 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a6357-75d3-477e-b8d3-27e6b96bb23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:30.957062 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-b40a6357-75d3-477e-b8d3-27e6b96bb23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:31.092017 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a6357-75d3-477e-b8d3-27e6b96bb23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:31.094157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a6357-75d3-477e-b8d3-27e6b96bb23e service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:31.114739 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 674/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:35.466032 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5c54d-48d7-4d2e-a52b-065bbb8d941a None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:35.466538 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5c54d-48d7-4d2e-a52b-065bbb8d941a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:35.466632 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5c54d-48d7-4d2e-a52b-065bbb8d941a None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:35.468123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 673/1347] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:35.474290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce147-2eb9-44dc-a7cd-95cba227aa7f None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:35.474711 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce147-2eb9-44dc-a7cd-95cba227aa7f None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:35.474845 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ce147-2eb9-44dc-a7cd-95cba227aa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:35.499693 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:35.555647 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-532ce147-2eb9-44dc-a7cd-95cba227aa7f None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:35.556873 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-532ce147-2eb9-44dc-a7cd-95cba227aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:35.655323 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 675/1348] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:35.944094 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5c54d-48d7-4d2e-a52b-065bbb8d941a None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:35.945652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-46e5c54d-48d7-4d2e-a52b-065bbb8d941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:36.003631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:36.048876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5c54d-48d7-4d2e-a52b-065bbb8d941a None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:36.121513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e103cc0-7b96-4994-ab69-07b867e5b296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:36.122125 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103cc0-7b96-4994-ab69-07b867e5b296 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:36.122408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103cc0-7b96-4994-ab69-07b867e5b296 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:36.122686 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103cc0-7b96-4994-ab69-07b867e5b296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:36.125029 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-4e103cc0-7b96-4994-ab69-07b867e5b296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:36.232408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:36.236444 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e103cc0-7b96-4994-ab69-07b867e5b296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:36.238254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e103cc0-7b96-4994-ab69-07b867e5b296 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:36.256804 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 674/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:41.159941 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e0a80-2920-4549-a2a4-8763a96a118e None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:41.160427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e0a80-2920-4549-a2a4-8763a96a118e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:41.160528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e0a80-2920-4549-a2a4-8763a96a118e None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:41.161818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 676/1350] 10.222.0.39 () {54 vars in 921 bytes} [Mon Oct 3 14:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:41.167226 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421a6f3-2a9f-47e1-bdde-d4d6c180aa53 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:41.167678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421a6f3-2a9f-47e1-bdde-d4d6c180aa53 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:41.167842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421a6f3-2a9f-47e1-bdde-d4d6c180aa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:41.274230 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-3421a6f3-2a9f-47e1-bdde-d4d6c180aa53 None None] MFA Rules not processed for user `d89b836f341b419dad35887c46d68730`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:41.276682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-3421a6f3-2a9f-47e1-bdde-d4d6c180aa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:41.457949 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 675/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Oct 3 14:44:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:45.653751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=59 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:45.682427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ea49-562c-4235-9e34-708aa54b4704 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:45.683055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ea49-562c-4235-9e34-708aa54b4704 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:45.683490 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ea49-562c-4235-9e34-708aa54b4704 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:45.684998 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 677/1352] 10.222.0.39 () {54 vars in 921 bytes} [Mon Oct 3 14:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:45.690218 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6c922-29be-435b-9352-a9cd9be9eb5a None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:45.690672 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6c922-29be-435b-9352-a9cd9be9eb5a None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:45.690779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6c922-29be-435b-9352-a9cd9be9eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:45.747977 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:45.773211 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-59b6c922-29be-435b-9352-a9cd9be9eb5a None None] MFA Rules not processed for user `d89b836f341b419dad35887c46d68730`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:45.774420 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-59b6c922-29be-435b-9352-a9cd9be9eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:45.890151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 676/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Oct 3 14:44:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:47.244732 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff43f65-e723-4a36-a64b-ac26599ba6b2 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:47.245263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff43f65-e723-4a36-a64b-ac26599ba6b2 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:47.245263 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff43f65-e723-4a36-a64b-ac26599ba6b2 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:47.246768 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 678/1354] 10.222.0.39 () {54 vars in 921 bytes} [Mon Oct 3 14:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:47.251783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a17f56-2f3a-42e3-9f58-f2e883f97588 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:47.252178 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a17f56-2f3a-42e3-9f58-f2e883f97588 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:47.252364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a17f56-2f3a-42e3-9f58-f2e883f97588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:47.328616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-f4a17f56-2f3a-42e3-9f58-f2e883f97588 None None] MFA Rules not processed for user `d89b836f341b419dad35887c46d68730`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:47.329799 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-f4a17f56-2f3a-42e3-9f58-f2e883f97588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:47.372846 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:47.441020 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 677/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Oct 3 14:44:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:50.970290 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa611000-0eb7-4055-ae00-05a52efad682 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:50.970785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa611000-0eb7-4055-ae00-05a52efad682 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:50.970785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa611000-0eb7-4055-ae00-05a52efad682 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:50.972652 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 679/1356] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:50.978121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e9ea-149b-4cbd-90f6-962e6959b05e None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:50.978621 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e9ea-149b-4cbd-90f6-962e6959b05e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:50.978706 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5e9ea-149b-4cbd-90f6-962e6959b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:51.057158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-8bd5e9ea-149b-4cbd-90f6-962e6959b05e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:51.058232 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-8bd5e9ea-149b-4cbd-90f6-962e6959b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:51.163031 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 678/1357] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:51.464622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ce1f5-dd6d-4e4d-80e7-12f47332b25d None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:51.465258 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ce1f5-dd6d-4e4d-80e7-12f47332b25d None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:51.465734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ce1f5-dd6d-4e4d-80e7-12f47332b25d None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:51.468421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 680/1358] 10.222.0.39 () {54 vars in 961 bytes} [Mon Oct 3 14:44:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:51.476973 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f61572-6e31-4479-b174-ace1adedaf3e None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:51.477632 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f61572-6e31-4479-b174-ace1adedaf3e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:51.478221 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f61572-6e31-4479-b174-ace1adedaf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:51.512886 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:51.573980 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-09f61572-6e31-4479-b174-ace1adedaf3e None None] MFA Rules not processed for user `bfb0254e89514ff18e1c91dc427e4b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:51.575322 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-09f61572-6e31-4479-b174-ace1adedaf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:51.692881 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 679/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Oct 3 14:44:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:51.700359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ce1f5-dd6d-4e4d-80e7-12f47332b25d None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:51.702786 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-ab7ce1f5-dd6d-4e4d-80e7-12f47332b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:51.862612 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ce1f5-dd6d-4e4d-80e7-12f47332b25d None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:51.939141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:51.982224 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bed879-ea09-4e15-9805-82174859bf26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:51.984106 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed879-ea09-4e15-9805-82174859bf26 service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:51.984569 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed879-ea09-4e15-9805-82174859bf26 service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:51.984999 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed879-ea09-4e15-9805-82174859bf26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:51.986727 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-38bed879-ea09-4e15-9805-82174859bf26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:52.099368 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bed879-ea09-4e15-9805-82174859bf26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:52.101124 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bed879-ea09-4e15-9805-82174859bf26 service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:52.121253 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 681/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:54.586877 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670159a5-365f-4626-8c1b-94c844dfbcbb None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:54.586877 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670159a5-365f-4626-8c1b-94c844dfbcbb None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:54.586877 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670159a5-365f-4626-8c1b-94c844dfbcbb None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:54.591182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70895ada-7dec-4b9c-bcd3-8f53b9598b43 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:54.591621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70895ada-7dec-4b9c-bcd3-8f53b9598b43 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:54.591774 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70895ada-7dec-4b9c-bcd3-8f53b9598b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:54.596950 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 680/1361] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:54.664744 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-70895ada-7dec-4b9c-bcd3-8f53b9598b43 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:54.666999 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-70895ada-7dec-4b9c-bcd3-8f53b9598b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:54.710867 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:54.775796 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 682/1362] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 14:44:55.074080 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670159a5-365f-4626-8c1b-94c844dfbcbb None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:55.075603 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-670159a5-365f-4626-8c1b-94c844dfbcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:55.156916 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:55.268202 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670159a5-365f-4626-8c1b-94c844dfbcbb None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:55.404267 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42181e81-bf3b-41a6-b503-5fd0df047995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:55.405343 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42181e81-bf3b-41a6-b503-5fd0df047995 service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:55.405668 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42181e81-bf3b-41a6-b503-5fd0df047995 service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:55.405978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42181e81-bf3b-41a6-b503-5fd0df047995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:55.407616 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-42181e81-bf3b-41a6-b503-5fd0df047995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:55.433406 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:55.503835 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42181e81-bf3b-41a6-b503-5fd0df047995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:55.505461 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42181e81-bf3b-41a6-b503-5fd0df047995 service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:55.523336 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 681/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:58.059714 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0643fb5-a79a-4470-9f0d-63f8fd6a3097 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:58.060223 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0643fb5-a79a-4470-9f0d-63f8fd6a3097 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:58.060223 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0643fb5-a79a-4470-9f0d-63f8fd6a3097 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:58.061703 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 683/1364] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:58.067280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e822b-e169-417d-b3ad-653b3e76e4bc None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:58.067699 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e822b-e169-417d-b3ad-653b3e76e4bc None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:58.067842 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e822b-e169-417d-b3ad-653b3e76e4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:58.150734 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-067e822b-e169-417d-b3ad-653b3e76e4bc None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:58.152014 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-067e822b-e169-417d-b3ad-653b3e76e4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:58.262422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:58.271276 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 682/1365] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:58.560110 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b087-4d18-40c3-8a0b-b4ac3202953d None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:58.560468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b087-4d18-40c3-8a0b-b4ac3202953d None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:58.560828 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b087-4d18-40c3-8a0b-b4ac3202953d None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:58.562429 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 684/1366] 10.222.0.39 () {54 vars in 961 bytes} [Mon Oct 3 14:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:58.567985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94650e-3304-4ac6-b98c-48db532d0119 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:58.568265 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94650e-3304-4ac6-b98c-48db532d0119 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:58.568544 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94650e-3304-4ac6-b98c-48db532d0119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:58.647856 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-6d94650e-3304-4ac6-b98c-48db532d0119 None None] MFA Rules not processed for user `bfb0254e89514ff18e1c91dc427e4b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:58.649028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-6d94650e-3304-4ac6-b98c-48db532d0119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:58.770906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 683/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Oct 3 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:58.779187 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b087-4d18-40c3-8a0b-b4ac3202953d None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:58.782217 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-91f0b087-4d18-40c3-8a0b-b4ac3202953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:58.946356 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b087-4d18-40c3-8a0b-b4ac3202953d None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:44:58.967986 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:59.068736 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f66d-ef94-4b41-a821-acee3d99db3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:44:59.069441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f66d-ef94-4b41-a821-acee3d99db3c service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:59.069689 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f66d-ef94-4b41-a821-acee3d99db3c service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:59.070084 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f66d-ef94-4b41-a821-acee3d99db3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:59.071865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-ae08f66d-ef94-4b41-a821-acee3d99db3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:59.176725 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08f66d-ef94-4b41-a821-acee3d99db3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:44:59.178475 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08f66d-ef94-4b41-a821-acee3d99db3c service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:44:59.197135 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395efed-3987-45db-b2c1-9d277d4c53d1 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:59.197631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395efed-3987-45db-b2c1-9d277d4c53d1 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:59.197631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395efed-3987-45db-b2c1-9d277d4c53d1 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:59.198478 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 685/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:44:59.199182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 684/1369] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:44:59.209574 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d52aa-4939-4fe8-8927-bf7a11f6fd14 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:59.209866 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d52aa-4939-4fe8-8927-bf7a11f6fd14 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:59.210145 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d52aa-4939-4fe8-8927-bf7a11f6fd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:59.244435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:59.288529 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-788d52aa-4939-4fe8-8927-bf7a11f6fd14 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:59.289893 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-788d52aa-4939-4fe8-8927-bf7a11f6fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:59.421359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 686/1370] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:59.752209 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151c965-07cb-4a1f-b52e-f128f7f008a9 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:59.752209 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151c965-07cb-4a1f-b52e-f128f7f008a9 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:59.752209 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151c965-07cb-4a1f-b52e-f128f7f008a9 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:59.753657 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 685/1371] 10.222.0.39 () {54 vars in 963 bytes} [Mon Oct 3 14:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:44:59.758417 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e62524-fad8-42de-96a7-a2249a09ce14 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:44:59.758806 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e62524-fad8-42de-96a7-a2249a09ce14 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:44:59.759197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e62524-fad8-42de-96a7-a2249a09ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:44:59.852085 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-d2e62524-fad8-42de-96a7-a2249a09ce14 None None] MFA Rules not processed for user `986544a87d444d57a9f6b2018f11967d`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:44:59.853243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-d2e62524-fad8-42de-96a7-a2249a09ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:44:59.908765 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:44:59.940673 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 687/1372] 10.222.0.39 () {58 vars in 1060 bytes} [Mon Oct 3 14:44:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:44:59.948012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151c965-07cb-4a1f-b52e-f128f7f008a9 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:44:59.949496 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-6151c965-07cb-4a1f-b52e-f128f7f008a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:00.002918 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:00.061323 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151c965-07cb-4a1f-b52e-f128f7f008a9 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:00.159589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977ad21-3c6f-45de-a4fa-c2311a18888b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986544a87d444d57a9f6b2018f11967d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:00.160868 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ad21-3c6f-45de-a4fa-c2311a18888b service cinder] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:00.161569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ad21-3c6f-45de-a4fa-c2311a18888b service cinder] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:00.162266 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ad21-3c6f-45de-a4fa-c2311a18888b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:00.165498 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-b977ad21-3c6f-45de-a4fa-c2311a18888b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:00.299316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:00.325489 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977ad21-3c6f-45de-a4fa-c2311a18888b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:00.327199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977ad21-3c6f-45de-a4fa-c2311a18888b service cinder] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:00.350569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 686/1373] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:01.439922 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85e7a-795e-4eef-945f-e9d978f27eb8 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:01.440459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85e7a-795e-4eef-945f-e9d978f27eb8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:01.440459 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff85e7a-795e-4eef-945f-e9d978f27eb8 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:01.441803 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 688/1374] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:01.446928 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cd0ee-ba47-44e0-9783-273fa78c3a6e None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:01.447365 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cd0ee-ba47-44e0-9783-273fa78c3a6e None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:01.447485 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cd0ee-ba47-44e0-9783-273fa78c3a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:01.512738 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-2a3cd0ee-ba47-44e0-9783-273fa78c3a6e None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:01.514545 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-2a3cd0ee-ba47-44e0-9783-273fa78c3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:01.610129 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 687/1375] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:01.904152 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85e7a-795e-4eef-945f-e9d978f27eb8 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:01.907122 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-eff85e7a-795e-4eef-945f-e9d978f27eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:02.072792 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff85e7a-795e-4eef-945f-e9d978f27eb8 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:02.132645 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:02.203276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092197a3-8746-43f6-a486-8bd4580608fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:02.203812 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092197a3-8746-43f6-a486-8bd4580608fa service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:02.204057 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092197a3-8746-43f6-a486-8bd4580608fa service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:02.204324 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092197a3-8746-43f6-a486-8bd4580608fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:02.205952 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-092197a3-8746-43f6-a486-8bd4580608fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:02.313705 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092197a3-8746-43f6-a486-8bd4580608fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:02.315460 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092197a3-8746-43f6-a486-8bd4580608fa service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:02.335746 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 689/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:04.725183 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41df82-6869-4b64-a7ee-b77c8d657654 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:04.725724 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41df82-6869-4b64-a7ee-b77c8d657654 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:04.725836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41df82-6869-4b64-a7ee-b77c8d657654 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:04.727408 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 688/1377] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:04.733690 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a9203-3ac8-4678-b2e1-bce3de353af6 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:04.734141 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a9203-3ac8-4678-b2e1-bce3de353af6 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:04.734363 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a9203-3ac8-4678-b2e1-bce3de353af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:04.808619 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-9f2a9203-3ac8-4678-b2e1-bce3de353af6 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:04.810205 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-9f2a9203-3ac8-4678-b2e1-bce3de353af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:04.819000 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:04.934992 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 690/1378] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:05.251759 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41df82-6869-4b64-a7ee-b77c8d657654 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:05.253404 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-8f41df82-6869-4b64-a7ee-b77c8d657654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:05.325019 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:05.425908 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41df82-6869-4b64-a7ee-b77c8d657654 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:05.559885 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6265c-2daa-4f5d-9050-17527377e4c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:05.561211 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6265c-2daa-4f5d-9050-17527377e4c3 service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:05.561718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6265c-2daa-4f5d-9050-17527377e4c3 service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:05.562025 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6265c-2daa-4f5d-9050-17527377e4c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:05.563768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-b8c6265c-2daa-4f5d-9050-17527377e4c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:05.587738 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:05.683290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6265c-2daa-4f5d-9050-17527377e4c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:05.685422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6265c-2daa-4f5d-9050-17527377e4c3 service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:05.708854 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 689/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:08.088651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f8162-8699-4970-a246-930974f5c210 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:08.089502 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f8162-8699-4970-a246-930974f5c210 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:08.089785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f8162-8699-4970-a246-930974f5c210 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:08.091192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 691/1380] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:08.098423 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a521f-6b46-4828-9e96-239f3c9df1f0 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:08.098941 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a521f-6b46-4828-9e96-239f3c9df1f0 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:08.099519 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a521f-6b46-4828-9e96-239f3c9df1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:08.218837 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-fc0a521f-6b46-4828-9e96-239f3c9df1f0 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:08.221195 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-fc0a521f-6b46-4828-9e96-239f3c9df1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:08.322343 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:08.329636 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 690/1381] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:08.633638 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f8162-8699-4970-a246-930974f5c210 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:08.635189 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-126f8162-8699-4970-a246-930974f5c210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:08.806279 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:08.819093 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f8162-8699-4970-a246-930974f5c210 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:08.937440 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214f64-fed6-485f-a1ed-c2794c2ff897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:08.937928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214f64-fed6-485f-a1ed-c2794c2ff897 service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:08.938286 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214f64-fed6-485f-a1ed-c2794c2ff897 service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:08.938479 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214f64-fed6-485f-a1ed-c2794c2ff897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:08.941544 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-7e214f64-fed6-485f-a1ed-c2794c2ff897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:09.043994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e214f64-fed6-485f-a1ed-c2794c2ff897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:09.046724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e214f64-fed6-485f-a1ed-c2794c2ff897 service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:09.058724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:09.069105 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 692/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:11.287903 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49201e97-169f-4ca8-b14b-c3b6c26dab8d None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:11.288633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49201e97-169f-4ca8-b14b-c3b6c26dab8d None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:11.288633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49201e97-169f-4ca8-b14b-c3b6c26dab8d None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:11.289806 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 691/1383] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:11.298136 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57211132-d95c-458c-a6f9-f2da526896eb None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:11.299018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57211132-d95c-458c-a6f9-f2da526896eb None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:11.299018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57211132-d95c-458c-a6f9-f2da526896eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:11.370769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-57211132-d95c-458c-a6f9-f2da526896eb None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:11.372023 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-57211132-d95c-458c-a6f9-f2da526896eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:11.477960 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 693/1384] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 14:45:11.768768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49201e97-169f-4ca8-b14b-c3b6c26dab8d None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:11.770292 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-49201e97-169f-4ca8-b14b-c3b6c26dab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:11.932853 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49201e97-169f-4ca8-b14b-c3b6c26dab8d None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:12.010700 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:12.060385 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683c818-8878-4f80-9b15-02c34e492a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:12.061077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683c818-8878-4f80-9b15-02c34e492a53 service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:12.061371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683c818-8878-4f80-9b15-02c34e492a53 service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:12.061714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683c818-8878-4f80-9b15-02c34e492a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:12.063338 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-b683c818-8878-4f80-9b15-02c34e492a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:12.179837 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683c818-8878-4f80-9b15-02c34e492a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:12.181508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683c818-8878-4f80-9b15-02c34e492a53 service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:12.201614 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 692/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:14.457869 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f3e3b-8ca6-4444-bfe4-1a4b9af91799 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:14.458445 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f3e3b-8ca6-4444-bfe4-1a4b9af91799 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:14.458445 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f3e3b-8ca6-4444-bfe4-1a4b9af91799 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:14.459928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 694/1386] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:14.465168 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809748c1-d1f7-4ca4-a4e8-2f5c00909983 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:14.465653 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809748c1-d1f7-4ca4-a4e8-2f5c00909983 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:14.465767 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809748c1-d1f7-4ca4-a4e8-2f5c00909983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:14.534076 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-809748c1-d1f7-4ca4-a4e8-2f5c00909983 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:14.535316 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-809748c1-d1f7-4ca4-a4e8-2f5c00909983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:14.568664 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:14.633297 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 693/1387] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:14.921699 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f3e3b-8ca6-4444-bfe4-1a4b9af91799 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:14.923239 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-d78f3e3b-8ca6-4444-bfe4-1a4b9af91799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:14.999312 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:15.069725 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f3e3b-8ca6-4444-bfe4-1a4b9af91799 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:15.188723 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52fe4-7114-4aac-b7b8-0fbdc93469dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:15.189245 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52fe4-7114-4aac-b7b8-0fbdc93469dd service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:15.189523 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52fe4-7114-4aac-b7b8-0fbdc93469dd service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:15.189793 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52fe4-7114-4aac-b7b8-0fbdc93469dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:15.191403 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-58e52fe4-7114-4aac-b7b8-0fbdc93469dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:15.231084 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:15.284778 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52fe4-7114-4aac-b7b8-0fbdc93469dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:15.286359 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52fe4-7114-4aac-b7b8-0fbdc93469dd service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:15.304402 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 695/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:15.820491 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f312f-edff-4d8e-8bdd-d954b0598fd2 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:15.821065 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f312f-edff-4d8e-8bdd-d954b0598fd2 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:15.821065 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f312f-edff-4d8e-8bdd-d954b0598fd2 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:15.822412 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 694/1389] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:45:15.828099 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea320ad-2bc1-4a2d-b250-c2dd616a29b6 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:15.828519 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea320ad-2bc1-4a2d-b250-c2dd616a29b6 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:15.828628 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea320ad-2bc1-4a2d-b250-c2dd616a29b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:15.895138 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-3ea320ad-2bc1-4a2d-b250-c2dd616a29b6 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:15.896324 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-3ea320ad-2bc1-4a2d-b250-c2dd616a29b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:15.992211 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 696/1390] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:16.289109 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789512f-5ae9-4efe-90b8-5a15a24543ca None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:16.289399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789512f-5ae9-4efe-90b8-5a15a24543ca None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:16.289679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789512f-5ae9-4efe-90b8-5a15a24543ca None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:16.291041 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 695/1391] 10.222.0.39 () {54 vars in 962 bytes} [Mon Oct 3 14:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:16.296503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78995bb4-f05b-4562-b8d8-bf9fcf6d20de None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:16.296895 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78995bb4-f05b-4562-b8d8-bf9fcf6d20de None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:16.297170 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78995bb4-f05b-4562-b8d8-bf9fcf6d20de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:16.313333 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:16.374755 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-78995bb4-f05b-4562-b8d8-bf9fcf6d20de None None] MFA Rules not processed for user `f43a588d7ac34be7a8c2140a42e10dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:16.375898 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-78995bb4-f05b-4562-b8d8-bf9fcf6d20de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:16.452410 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 697/1392] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Oct 3 14:45:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 14:45:16.461440 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789512f-5ae9-4efe-90b8-5a15a24543ca None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:16.462985 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-6789512f-5ae9-4efe-90b8-5a15a24543ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:16.569151 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789512f-5ae9-4efe-90b8-5a15a24543ca None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:16.631795 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:16.648238 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42272a88-aef1-4af3-b96b-39b997fe7950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a588d7ac34be7a8c2140a42e10dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:16.648843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42272a88-aef1-4af3-b96b-39b997fe7950 service glance] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:16.649121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42272a88-aef1-4af3-b96b-39b997fe7950 service glance] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:16.649393 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42272a88-aef1-4af3-b96b-39b997fe7950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:16.650966 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-42272a88-aef1-4af3-b96b-39b997fe7950 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:16.759144 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42272a88-aef1-4af3-b96b-39b997fe7950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:16.760567 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42272a88-aef1-4af3-b96b-39b997fe7950 service glance] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:16.778869 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 696/1393] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:17.522618 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76070881-ca72-4d06-881e-41857b29e24a None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:17.523170 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76070881-ca72-4d06-881e-41857b29e24a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:17.523266 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76070881-ca72-4d06-881e-41857b29e24a None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:17.524807 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 698/1394] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:17.530721 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711dbd0-5334-4480-ad57-687424454556 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:17.531117 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711dbd0-5334-4480-ad57-687424454556 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:17.531493 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711dbd0-5334-4480-ad57-687424454556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:17.537926 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421338e-d7ce-4371-a522-c5d26cec7e8f None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:17.538206 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421338e-d7ce-4371-a522-c5d26cec7e8f None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:17.538482 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421338e-d7ce-4371-a522-c5d26cec7e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:17.598158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-6711dbd0-5334-4480-ad57-687424454556 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:17.599440 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-6711dbd0-5334-4480-ad57-687424454556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:17.607302 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-4421338e-d7ce-4371-a522-c5d26cec7e8f None None] MFA Rules not processed for user `48ba8f16b64e4625866d7052846d906a`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:17.608598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-4421338e-d7ce-4371-a522-c5d26cec7e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:17.640871 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:17.664773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:17.697230 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 699/1395] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Oct 3 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 14:45:17.697692 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 697/1396] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:17.739701 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc583-5875-4e96-b674-7eefa6b0a213 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:17.740072 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc583-5875-4e96-b674-7eefa6b0a213 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:17.740399 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc583-5875-4e96-b674-7eefa6b0a213 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:17.742069 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 700/1397] 10.222.0.39 () {54 vars in 943 bytes} [Mon Oct 3 14:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:17.749290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f413a1-d520-4e4e-b8bf-6c2adcdc00ba None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:17.749582 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f413a1-d520-4e4e-b8bf-6c2adcdc00ba None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:17.749861 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f413a1-d520-4e4e-b8bf-6c2adcdc00ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:17.827414 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-b3f413a1-d520-4e4e-b8bf-6c2adcdc00ba None None] MFA Rules not processed for user `29b7487e76304a87bd9d07d1f63b01d3`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:17.828536 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-b3f413a1-d520-4e4e-b8bf-6c2adcdc00ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:17.934369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 698/1398] 10.222.0.39 () {58 vars in 1040 bytes} [Mon Oct 3 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:17.945297 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fc583-5875-4e96-b674-7eefa6b0a213 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:17.946911 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-1b1fc583-5875-4e96-b674-7eefa6b0a213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:17.992598 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f413a1-d520-4e4e-b8bf-6c2adcdc00ba None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:17.993796 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-b3f413a1-d520-4e4e-b8bf-6c2adcdc00ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:17.997069 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:18.094688 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fc583-5875-4e96-b674-7eefa6b0a213 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:18.096867 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f413a1-d520-4e4e-b8bf-6c2adcdc00ba None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:18.157439 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:18.205275 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c213d-d23f-4b9c-841e-b568c2bcbd57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b7487e76304a87bd9d07d1f63b01d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:18.205945 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c213d-d23f-4b9c-841e-b568c2bcbd57 service swift] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:18.206226 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c213d-d23f-4b9c-841e-b568c2bcbd57 service swift] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:18.206499 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c213d-d23f-4b9c-841e-b568c2bcbd57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:18.208155 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-659c213d-d23f-4b9c-841e-b568c2bcbd57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:18.213643 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78800d76-acb4-4d1b-8e4e-7266c9eebd9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:18.214251 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800d76-acb4-4d1b-8e4e-7266c9eebd9b service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:18.214530 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800d76-acb4-4d1b-8e4e-7266c9eebd9b service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:18.214803 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800d76-acb4-4d1b-8e4e-7266c9eebd9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:18.216439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-78800d76-acb4-4d1b-8e4e-7266c9eebd9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:18.228604 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:18.293839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c213d-d23f-4b9c-841e-b568c2bcbd57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:18.295984 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c213d-d23f-4b9c-841e-b568c2bcbd57 service swift] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:18.304071 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 701/1399] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Oct 3 14:45:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 14:45:18.313580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78800d76-acb4-4d1b-8e4e-7266c9eebd9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:18.315240 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78800d76-acb4-4d1b-8e4e-7266c9eebd9b service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:18.335348 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 699/1400] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 14:45:20.603843 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991e54-8681-47ee-a1b2-b6db3b73f081 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:20.604401 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991e54-8681-47ee-a1b2-b6db3b73f081 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:20.604513 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991e54-8681-47ee-a1b2-b6db3b73f081 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:20.605789 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 702/1401] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:20.611301 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff4e02-5849-46f9-9336-3ee9d1ef5c85 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:20.611718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff4e02-5849-46f9-9336-3ee9d1ef5c85 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:20.611898 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff4e02-5849-46f9-9336-3ee9d1ef5c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:20.687483 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-6eff4e02-5849-46f9-9336-3ee9d1ef5c85 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:20.688702 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-6eff4e02-5849-46f9-9336-3ee9d1ef5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:20.783758 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:20.796681 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 700/1402] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:21.094396 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991e54-8681-47ee-a1b2-b6db3b73f081 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:21.095959 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-1b991e54-8681-47ee-a1b2-b6db3b73f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:21.200148 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:21.265522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991e54-8681-47ee-a1b2-b6db3b73f081 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:21.411902 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a166b-49b8-44b3-a8c4-e04fa7a0cf12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:21.412761 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a166b-49b8-44b3-a8c4-e04fa7a0cf12 service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:21.413250 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a166b-49b8-44b3-a8c4-e04fa7a0cf12 service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:21.413654 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a166b-49b8-44b3-a8c4-e04fa7a0cf12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:21.416328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-a26a166b-49b8-44b3-a8c4-e04fa7a0cf12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:21.496169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:21.533108 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a166b-49b8-44b3-a8c4-e04fa7a0cf12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:21.534827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a166b-49b8-44b3-a8c4-e04fa7a0cf12 service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:21.553933 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 703/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:23.876948 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2343b-c3b7-43cc-9fed-4ffbdb90cc0b None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:23.877521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2343b-c3b7-43cc-9fed-4ffbdb90cc0b None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:23.877521 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2343b-c3b7-43cc-9fed-4ffbdb90cc0b None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:23.878835 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 701/1404] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:23.884157 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d38a7-cd97-4b80-ab9c-aae3234c2f0a None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:23.885111 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d38a7-cd97-4b80-ab9c-aae3234c2f0a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:23.885468 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d38a7-cd97-4b80-ab9c-aae3234c2f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:23.959187 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-8d1d38a7-cd97-4b80-ab9c-aae3234c2f0a None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:23.960489 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-8d1d38a7-cd97-4b80-ab9c-aae3234c2f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:24.063515 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 704/1405] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:24.353356 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2343b-c3b7-43cc-9fed-4ffbdb90cc0b None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:24.354971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-e5b2343b-c3b7-43cc-9fed-4ffbdb90cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:24.533193 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2343b-c3b7-43cc-9fed-4ffbdb90cc0b None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:24.605870 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:24.662467 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ebf8b-5a6d-46d9-bf91-8cf0ad3cc959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:24.663473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ebf8b-5a6d-46d9-bf91-8cf0ad3cc959 service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:24.663964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ebf8b-5a6d-46d9-bf91-8cf0ad3cc959 service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:24.664404 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ebf8b-5a6d-46d9-bf91-8cf0ad3cc959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:24.666201 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-985ebf8b-5a6d-46d9-bf91-8cf0ad3cc959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:24.766036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ebf8b-5a6d-46d9-bf91-8cf0ad3cc959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:24.767779 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ebf8b-5a6d-46d9-bf91-8cf0ad3cc959 service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:24.788739 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 702/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:27.044558 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf461-92ed-44c8-bd86-cf3827710b97 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:27.045043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf461-92ed-44c8-bd86-cf3827710b97 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:27.045129 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf461-92ed-44c8-bd86-cf3827710b97 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:27.048285 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 705/1407] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:27.051821 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17999a-e4f4-4414-973f-c32dd5dde5c9 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:27.052266 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17999a-e4f4-4414-973f-c32dd5dde5c9 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:27.052373 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17999a-e4f4-4414-973f-c32dd5dde5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:27.131744 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-ef17999a-e4f4-4414-973f-c32dd5dde5c9 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:27.133026 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-ef17999a-e4f4-4414-973f-c32dd5dde5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:27.165844 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:27.244116 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 703/1408] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:27.543492 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbf461-92ed-44c8-bd86-cf3827710b97 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:27.545895 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-fdcbf461-92ed-44c8-bd86-cf3827710b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:27.587203 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:27.711288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbf461-92ed-44c8-bd86-cf3827710b97 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:27.832841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:27.838535 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe1cdd-64bb-4ed3-a13c-7b343e6df882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:27.839178 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe1cdd-64bb-4ed3-a13c-7b343e6df882 service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:27.839455 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe1cdd-64bb-4ed3-a13c-7b343e6df882 service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:27.839724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe1cdd-64bb-4ed3-a13c-7b343e6df882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:27.842006 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-ddbe1cdd-64bb-4ed3-a13c-7b343e6df882 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:27.942918 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe1cdd-64bb-4ed3-a13c-7b343e6df882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:27.944555 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe1cdd-64bb-4ed3-a13c-7b343e6df882 service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:27.975288 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 706/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:37.242422 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=31 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:37.961556 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=47 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:41.220120 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6002ad-7c4f-4bff-84f7-9ca342f6634b None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:41.220673 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6002ad-7c4f-4bff-84f7-9ca342f6634b None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:41.220673 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6002ad-7c4f-4bff-84f7-9ca342f6634b None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:41.222016 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 704/1410] 10.222.0.39 () {54 vars in 918 bytes} [Mon Oct 3 14:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:41.227301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ab828-06ee-41ac-9306-73f2929c1298 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:41.227754 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ab828-06ee-41ac-9306-73f2929c1298 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:41.227854 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ab828-06ee-41ac-9306-73f2929c1298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:41.305326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-7a5ab828-06ee-41ac-9306-73f2929c1298 None None] MFA Rules not processed for user `d89b836f341b419dad35887c46d68730`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:41.306535 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-7a5ab828-06ee-41ac-9306-73f2929c1298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:41.416133 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 707/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Oct 3 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:41.431305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09704f6-b555-4cdd-89a1-e9948badb772 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:41.431599 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09704f6-b555-4cdd-89a1-e9948badb772 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:41.431879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09704f6-b555-4cdd-89a1-e9948badb772 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:41.433214 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 705/1412] 10.222.0.39 () {54 vars in 918 bytes} [Mon Oct 3 14:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:41.438055 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912955-66d4-45ed-ab51-a2aabe8dec78 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:41.438347 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912955-66d4-45ed-ab51-a2aabe8dec78 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:41.438621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912955-66d4-45ed-ab51-a2aabe8dec78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:41.516420 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:41.518998 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-83912955-66d4-45ed-ab51-a2aabe8dec78 None None] MFA Rules not processed for user `bfb0254e89514ff18e1c91dc427e4b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:41.520739 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-83912955-66d4-45ed-ab51-a2aabe8dec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:41.635018 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 708/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Oct 3 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:44.218528 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0b28-2b7a-4c5b-966c-24640ed43e58 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:44.219294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0b28-2b7a-4c5b-966c-24640ed43e58 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:44.219294 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0b28-2b7a-4c5b-966c-24640ed43e58 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:44.220502 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:44.225670 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171866aa-a70c-44fe-a3f7-8851321ba6db None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:44.226047 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171866aa-a70c-44fe-a3f7-8851321ba6db None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:44.226216 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171866aa-a70c-44fe-a3f7-8851321ba6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:44.297307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-171866aa-a70c-44fe-a3f7-8851321ba6db None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:44.298501 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-171866aa-a70c-44fe-a3f7-8851321ba6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:44.355308 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:44.396308 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:44.691028 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d0b28-2b7a-4c5b-966c-24640ed43e58 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:44.692669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-c12d0b28-2b7a-4c5b-966c-24640ed43e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:44.837540 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d0b28-2b7a-4c5b-966c-24640ed43e58 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:44.909593 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:44.949458 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f408c2-610c-47b2-9185-38c2b1a7c9b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:44.950175 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f408c2-610c-47b2-9185-38c2b1a7c9b7 service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:44.950455 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f408c2-610c-47b2-9185-38c2b1a7c9b7 service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:44.950728 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f408c2-610c-47b2-9185-38c2b1a7c9b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:44.952332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-d3f408c2-610c-47b2-9185-38c2b1a7c9b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:45.043951 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f408c2-610c-47b2-9185-38c2b1a7c9b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:45.045558 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f408c2-610c-47b2-9185-38c2b1a7c9b7 service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:45.063439 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 707/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:46.213837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e383d-c7a8-4976-a87f-bf2bb6bef560 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:46.214394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e383d-c7a8-4976-a87f-bf2bb6bef560 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:46.214394 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e383d-c7a8-4976-a87f-bf2bb6bef560 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:46.216283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 14:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:46.222504 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc0e8-7a79-4bf9-9a9f-ef3d90276ff5 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:46.222978 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc0e8-7a79-4bf9-9a9f-ef3d90276ff5 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:46.223088 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc0e8-7a79-4bf9-9a9f-ef3d90276ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:46.299162 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-db2bc0e8-7a79-4bf9-9a9f-ef3d90276ff5 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:46.300339 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-db2bc0e8-7a79-4bf9-9a9f-ef3d90276ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:46.326865 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:46.402323 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 14:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:46.551212 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e383d-c7a8-4976-a87f-bf2bb6bef560 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:46.552699 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-bb7e383d-c7a8-4976-a87f-bf2bb6bef560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:46.698356 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e383d-c7a8-4976-a87f-bf2bb6bef560 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:46.856504 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:46.929710 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac72b4-435c-467c-ae88-9cdf52e6ff9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:46.930342 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac72b4-435c-467c-ae88-9cdf52e6ff9f service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:46.930615 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac72b4-435c-467c-ae88-9cdf52e6ff9f service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:46.930879 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac72b4-435c-467c-ae88-9cdf52e6ff9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:46.932460 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-f0ac72b4-435c-467c-ae88-9cdf52e6ff9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:47.022789 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac72b4-435c-467c-ae88-9cdf52e6ff9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:47.024326 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac72b4-435c-467c-ae88-9cdf52e6ff9f service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:47.042704 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 711/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:48.167693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc4708-5d21-4bb4-a207-a0012a5a3048 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:48.168314 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc4708-5d21-4bb4-a207-a0012a5a3048 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:48.168314 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc4708-5d21-4bb4-a207-a0012a5a3048 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:48.169633 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 14:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:48.175756 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1852-c7e9-48d5-acca-3dedeaf1a38f None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:48.176218 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1852-c7e9-48d5-acca-3dedeaf1a38f None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:48.176328 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef1852-c7e9-48d5-acca-3dedeaf1a38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:48.229755 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:48.251978 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-b6ef1852-c7e9-48d5-acca-3dedeaf1a38f None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:48.253159 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-b6ef1852-c7e9-48d5-acca-3dedeaf1a38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:48.348058 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:48.499863 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc4708-5d21-4bb4-a207-a0012a5a3048 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:48.501350 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-92fc4708-5d21-4bb4-a207-a0012a5a3048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:48.761685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc4708-5d21-4bb4-a207-a0012a5a3048 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:48.773988 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:48.873764 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750e38f-e361-4b21-8f3b-5178d284a565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:48.874366 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750e38f-e361-4b21-8f3b-5178d284a565 service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:48.874644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750e38f-e361-4b21-8f3b-5178d284a565 service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:48.874914 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750e38f-e361-4b21-8f3b-5178d284a565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:48.876514 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-f750e38f-e361-4b21-8f3b-5178d284a565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:48.962079 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750e38f-e361-4b21-8f3b-5178d284a565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:48.963690 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750e38f-e361-4b21-8f3b-5178d284a565 service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:48.981638 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 710/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:50.101222 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb981b04-42e1-43d7-890f-86c5ec3e2ae8 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:50.101700 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb981b04-42e1-43d7-890f-86c5ec3e2ae8 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:50.101805 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb981b04-42e1-43d7-890f-86c5ec3e2ae8 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:50.103172 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 14:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:50.109982 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95185f9-c784-4b6a-ad97-ee762f33ee79 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:50.110425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95185f9-c784-4b6a-ad97-ee762f33ee79 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:50.110551 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95185f9-c784-4b6a-ad97-ee762f33ee79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:50.130121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:50.185813 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-e95185f9-c784-4b6a-ad97-ee762f33ee79 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:50.187044 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-e95185f9-c784-4b6a-ad97-ee762f33ee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:50.283413 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:50.433373 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb981b04-42e1-43d7-890f-86c5ec3e2ae8 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:50.434830 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-bb981b04-42e1-43d7-890f-86c5ec3e2ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:50.552019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:50.587568 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb981b04-42e1-43d7-890f-86c5ec3e2ae8 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:50.698564 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590ff4d-e598-4971-a7bd-0f122fe192e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:50.699119 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590ff4d-e598-4971-a7bd-0f122fe192e0 service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:50.699963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590ff4d-e598-4971-a7bd-0f122fe192e0 service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:50.700232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590ff4d-e598-4971-a7bd-0f122fe192e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:50.701810 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-8590ff4d-e598-4971-a7bd-0f122fe192e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:50.776752 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:50.791366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590ff4d-e598-4971-a7bd-0f122fe192e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:50.792951 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590ff4d-e598-4971-a7bd-0f122fe192e0 service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:50.811401 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 714/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:51.916933 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31669a-b3fd-416a-bfcb-6c1231c8e4c4 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:51.917533 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31669a-b3fd-416a-bfcb-6c1231c8e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:51.917533 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31669a-b3fd-416a-bfcb-6c1231c8e4c4 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:51.918928 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 14:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:51.925243 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43cc93-612e-4226-ae65-285099e27146 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:51.925657 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43cc93-612e-4226-ae65-285099e27146 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:51.925803 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43cc93-612e-4226-ae65-285099e27146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:52.001164 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-1c43cc93-612e-4226-ae65-285099e27146 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:52.002294 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-1c43cc93-612e-4226-ae65-285099e27146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:52.099307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:52.248924 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31669a-b3fd-416a-bfcb-6c1231c8e4c4 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:52.250490 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-ca31669a-b3fd-416a-bfcb-6c1231c8e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:52.334292 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:52.398903 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31669a-b3fd-416a-bfcb-6c1231c8e4c4 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:52.512409 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6439bc-f93c-445e-bdd5-54dec4c4b6ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:52.513021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6439bc-f93c-445e-bdd5-54dec4c4b6ce service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:52.513303 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6439bc-f93c-445e-bdd5-54dec4c4b6ce service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:52.513575 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6439bc-f93c-445e-bdd5-54dec4c4b6ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:52.515292 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-3e6439bc-f93c-445e-bdd5-54dec4c4b6ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:52.562969 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:52.602489 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6439bc-f93c-445e-bdd5-54dec4c4b6ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:52.604094 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6439bc-f93c-445e-bdd5-54dec4c4b6ce service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:52.622910 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 713/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:53.691547 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7649bd6-2f22-40b5-b7a7-b282b46622eb None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:53.692121 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7649bd6-2f22-40b5-b7a7-b282b46622eb None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:53.692944 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7649bd6-2f22-40b5-b7a7-b282b46622eb None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:53.694287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 14:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:53.700821 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae561b6-e17c-492b-a6d2-0c9633db892b None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:53.701259 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae561b6-e17c-492b-a6d2-0c9633db892b None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:53.701380 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae561b6-e17c-492b-a6d2-0c9633db892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:53.775431 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-5ae561b6-e17c-492b-a6d2-0c9633db892b None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:53.776569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-5ae561b6-e17c-492b-a6d2-0c9633db892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:53.875332 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:54.025027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7649bd6-2f22-40b5-b7a7-b282b46622eb None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:54.026447 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-f7649bd6-2f22-40b5-b7a7-b282b46622eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:54.076914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:54.176674 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7649bd6-2f22-40b5-b7a7-b282b46622eb None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:54.287803 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96f60-c11a-453e-95c1-8abceb5a04c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:54.288367 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96f60-c11a-453e-95c1-8abceb5a04c4 service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:54.288647 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96f60-c11a-453e-95c1-8abceb5a04c4 service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:54.288920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96f60-c11a-453e-95c1-8abceb5a04c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:54.290513 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-5ab96f60-c11a-453e-95c1-8abceb5a04c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:54.297630 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:54.380208 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab96f60-c11a-453e-95c1-8abceb5a04c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:54.381828 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab96f60-c11a-453e-95c1-8abceb5a04c4 service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:54.400136 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 717/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:55.451056 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9bf4e-97be-4654-bbb2-862bbbfef6e9 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:55.451623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9bf4e-97be-4654-bbb2-862bbbfef6e9 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:55.451623 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9bf4e-97be-4654-bbb2-862bbbfef6e9 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:55.452946 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 14:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:55.459313 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d22f3-1334-4d17-b378-3146fc0c9aa4 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:55.459716 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d22f3-1334-4d17-b378-3146fc0c9aa4 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:55.459862 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d22f3-1334-4d17-b378-3146fc0c9aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:55.534858 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-f59d22f3-1334-4d17-b378-3146fc0c9aa4 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:55.536078 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-f59d22f3-1334-4d17-b378-3146fc0c9aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:55.604230 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:55.632229 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 14:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:55.789494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9bf4e-97be-4654-bbb2-862bbbfef6e9 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:55.790876 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-4ae9bf4e-97be-4654-bbb2-862bbbfef6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:55.807783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:55.932255 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9bf4e-97be-4654-bbb2-862bbbfef6e9 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:56.017670 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:56.043399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22749b-923f-40de-9828-c418d6065e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:56.043983 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22749b-923f-40de-9828-c418d6065e57 service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:56.044260 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22749b-923f-40de-9828-c418d6065e57 service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:56.044529 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22749b-923f-40de-9828-c418d6065e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:56.046077 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-2e22749b-923f-40de-9828-c418d6065e57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:56.135534 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22749b-923f-40de-9828-c418d6065e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:56.137955 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22749b-923f-40de-9828-c418d6065e57 service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:56.156141 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 716/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:57.209788 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03595796-83a7-49bc-a30b-5989c756562d None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:57.210315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03595796-83a7-49bc-a30b-5989c756562d None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:57.210315 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03595796-83a7-49bc-a30b-5989c756562d None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:57.211702 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 14:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:57.218035 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d110ff-fe59-49d9-8e74-28cc4a67025c None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:57.218487 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d110ff-fe59-49d9-8e74-28cc4a67025c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:57.218600 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d110ff-fe59-49d9-8e74-28cc4a67025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:57.293690 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-96d110ff-fe59-49d9-8e74-28cc4a67025c None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:57.294866 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-96d110ff-fe59-49d9-8e74-28cc4a67025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:57.336500 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:57.391082 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 14:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:57.548605 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03595796-83a7-49bc-a30b-5989c756562d None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:57.550014 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-03595796-83a7-49bc-a30b-5989c756562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:57.695126 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03595796-83a7-49bc-a30b-5989c756562d None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:57.754392 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:57.817110 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c21f3-5f19-4e71-9e69-c2ee5fb1ff2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:57.817633 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c21f3-5f19-4e71-9e69-c2ee5fb1ff2f service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:57.817915 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c21f3-5f19-4e71-9e69-c2ee5fb1ff2f service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:57.818192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c21f3-5f19-4e71-9e69-c2ee5fb1ff2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:57.819804 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-c27c21f3-5f19-4e71-9e69-c2ee5fb1ff2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:57.911301 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c21f3-5f19-4e71-9e69-c2ee5fb1ff2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:57.912867 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c21f3-5f19-4e71-9e69-c2ee5fb1ff2f service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:57.930844 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 720/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:45:58.988110 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2926389-2928-4c11-a694-6a2fbf599c86 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:58.988682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2926389-2928-4c11-a694-6a2fbf599c86 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:58.988682 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2926389-2928-4c11-a694-6a2fbf599c86 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:58.990016 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 14:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:45:58.997009 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be22fa1-c40e-4fad-9d4a-47c5b8e2ee07 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:58.997430 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be22fa1-c40e-4fad-9d4a-47c5b8e2ee07 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:58.997556 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be22fa1-c40e-4fad-9d4a-47c5b8e2ee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:59.073421 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-7be22fa1-c40e-4fad-9d4a-47c5b8e2ee07 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:45:59.075576 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-7be22fa1-c40e-4fad-9d4a-47c5b8e2ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:59.077598 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:59.175897 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 14:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:45:59.325999 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2926389-2928-4c11-a694-6a2fbf599c86 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:45:59.327451 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-f2926389-2928-4c11-a694-6a2fbf599c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:59.475994 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2926389-2928-4c11-a694-6a2fbf599c86 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:45:59.505822 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:45:59.590732 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d7ac7-3f89-423e-81e9-9f48ca12e5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:45:59.591364 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d7ac7-3f89-423e-81e9-9f48ca12e5cb service nova] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:45:59.591646 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d7ac7-3f89-423e-81e9-9f48ca12e5cb service nova] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:45:59.591915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d7ac7-3f89-423e-81e9-9f48ca12e5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:45:59.593492 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-e37d7ac7-3f89-423e-81e9-9f48ca12e5cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:45:59.683743 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d7ac7-3f89-423e-81e9-9f48ca12e5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:45:59.685304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d7ac7-3f89-423e-81e9-9f48ca12e5cb service nova] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:45:59.702792 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 719/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 14:46:01.762366 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1d4a-4302-4704-a899-e3701b9ecfce None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:01.762917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1d4a-4302-4704-a899-e3701b9ecfce None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:01.762917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1d4a-4302-4704-a899-e3701b9ecfce None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:01.764213 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:01.769382 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4553a3-84f5-4fdc-979a-b273efae1dc5 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:01.769768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4553a3-84f5-4fdc-979a-b273efae1dc5 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:01.769931 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4553a3-84f5-4fdc-979a-b273efae1dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:01.812576 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:01.837578 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-9f4553a3-84f5-4fdc-979a-b273efae1dc5 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:01.838765 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-9f4553a3-84f5-4fdc-979a-b273efae1dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:01.933804 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:02.222174 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1d4a-4302-4704-a899-e3701b9ecfce None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:02.223730 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-8b0d1d4a-4302-4704-a899-e3701b9ecfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:02.327167 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1d4a-4302-4704-a899-e3701b9ecfce None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:02.359895 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:02.401846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf248a-21b6-4ef8-a566-5f583209bfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:02.403154 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf248a-21b6-4ef8-a566-5f583209bfde service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:02.403498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf248a-21b6-4ef8-a566-5f583209bfde service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:02.403773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf248a-21b6-4ef8-a566-5f583209bfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:02.405352 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-dfcf248a-21b6-4ef8-a566-5f583209bfde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:02.514796 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf248a-21b6-4ef8-a566-5f583209bfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:02.516276 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf248a-21b6-4ef8-a566-5f583209bfde service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:02.535299 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 723/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:04.835324 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eaee0-7a8f-4100-a0d4-6edaf033614f None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:04.835864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eaee0-7a8f-4100-a0d4-6edaf033614f None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:04.835864 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eaee0-7a8f-4100-a0d4-6edaf033614f None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:04.837192 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:04.842430 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5eae3-18e3-4d93-82f8-6128a54b520d None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:04.842861 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5eae3-18e3-4d93-82f8-6128a54b520d None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:04.842999 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5eae3-18e3-4d93-82f8-6128a54b520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:04.910849 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-cee5eae3-18e3-4d93-82f8-6128a54b520d None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:04.912073 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-cee5eae3-18e3-4d93-82f8-6128a54b520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:04.925520 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:05.007967 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:05.297397 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eaee0-7a8f-4100-a0d4-6edaf033614f None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:05.298923 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-230eaee0-7a8f-4100-a0d4-6edaf033614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:05.400751 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eaee0-7a8f-4100-a0d4-6edaf033614f None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:05.414322 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:05.475701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf00e3-2989-446a-9957-48939bab5208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:05.476305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf00e3-2989-446a-9957-48939bab5208 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:05.476583 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf00e3-2989-446a-9957-48939bab5208 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:05.476851 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf00e3-2989-446a-9957-48939bab5208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:05.478418 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-11bf00e3-2989-446a-9957-48939bab5208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:05.584241 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf00e3-2989-446a-9957-48939bab5208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:05.585647 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf00e3-2989-446a-9957-48939bab5208 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:05.603494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 722/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:08.106737 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62919efd-05dc-4089-a371-4e85500665f5 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:08.107237 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62919efd-05dc-4089-a371-4e85500665f5 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:08.107341 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62919efd-05dc-4089-a371-4e85500665f5 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:08.108674 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:08.114167 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07693b01-3230-4be6-8f2f-2448691a7240 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:08.114569 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07693b01-3230-4be6-8f2f-2448691a7240 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:08.114718 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07693b01-3230-4be6-8f2f-2448691a7240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:08.163024 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:08.180690 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-07693b01-3230-4be6-8f2f-2448691a7240 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:08.181928 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-07693b01-3230-4be6-8f2f-2448691a7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:08.277747 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:08.565495 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62919efd-05dc-4089-a371-4e85500665f5 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:08.567060 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-62919efd-05dc-4089-a371-4e85500665f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:08.669522 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62919efd-05dc-4089-a371-4e85500665f5 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:08.708025 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:08.742827 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d329eb-c6af-40d1-9bee-1f81c24d300b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:08.743457 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d329eb-c6af-40d1-9bee-1f81c24d300b service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:08.743734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d329eb-c6af-40d1-9bee-1f81c24d300b service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:08.744007 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d329eb-c6af-40d1-9bee-1f81c24d300b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:08.745607 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-a0d329eb-c6af-40d1-9bee-1f81c24d300b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:08.853669 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d329eb-c6af-40d1-9bee-1f81c24d300b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:08.855802 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d329eb-c6af-40d1-9bee-1f81c24d300b service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:08.873580 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 726/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:11.229432 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea67d-5757-4654-8872-0eee17fbcda6 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:11.230047 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea67d-5757-4654-8872-0eee17fbcda6 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:11.230147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea67d-5757-4654-8872-0eee17fbcda6 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:11.231791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:11.237227 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb8724-7220-493e-8143-b027db52d640 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:11.237650 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb8724-7220-493e-8143-b027db52d640 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:11.237784 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb8724-7220-493e-8143-b027db52d640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:11.307322 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-a3bb8724-7220-493e-8143-b027db52d640 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:11.309012 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-a3bb8724-7220-493e-8143-b027db52d640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:11.330021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:11.409972 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 14:46:11.704177 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eea67d-5757-4654-8872-0eee17fbcda6 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:11.705722 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-d6eea67d-5757-4654-8872-0eee17fbcda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:11.808812 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eea67d-5757-4654-8872-0eee17fbcda6 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:11.828875 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:11.883753 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab882ba3-e35a-4086-81f0-6cdcf85d15e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:11.884383 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab882ba3-e35a-4086-81f0-6cdcf85d15e5 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:11.884661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab882ba3-e35a-4086-81f0-6cdcf85d15e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:11.884933 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab882ba3-e35a-4086-81f0-6cdcf85d15e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:11.886900 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-ab882ba3-e35a-4086-81f0-6cdcf85d15e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:11.995187 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab882ba3-e35a-4086-81f0-6cdcf85d15e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:11.996703 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab882ba3-e35a-4086-81f0-6cdcf85d15e5 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:12.014453 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 725/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:14.281250 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e256-b781-4d64-a190-4bf2f53c1c9e None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:14.281835 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e256-b781-4d64-a190-4bf2f53c1c9e None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:14.281835 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019e256-b781-4d64-a190-4bf2f53c1c9e None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:14.283202 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:14.288425 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb7494-5d77-4489-9cc2-d36a65f54797 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:14.288861 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb7494-5d77-4489-9cc2-d36a65f54797 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:14.289121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb7494-5d77-4489-9cc2-d36a65f54797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:14.354345 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:14.357678 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-78eb7494-5d77-4489-9cc2-d36a65f54797 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:14.359429 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-78eb7494-5d77-4489-9cc2-d36a65f54797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:14.456021 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:14.751019 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019e256-b781-4d64-a190-4bf2f53c1c9e None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:14.752537 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-0019e256-b781-4d64-a190-4bf2f53c1c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:14.859346 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019e256-b781-4d64-a190-4bf2f53c1c9e None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:14.909846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:14.934432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a8515-0ca7-4092-854e-df7378140e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:14.935039 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8515-0ca7-4092-854e-df7378140e69 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:14.935323 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8515-0ca7-4092-854e-df7378140e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:14.935593 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a8515-0ca7-4092-854e-df7378140e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:14.937169 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-769a8515-0ca7-4092-854e-df7378140e69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:15.049048 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a8515-0ca7-4092-854e-df7378140e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:15.050427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a8515-0ca7-4092-854e-df7378140e69 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:15.069567 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 729/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:17.286979 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c0eb-48e4-460e-9cae-6e37960f9682 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:17.287571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c0eb-48e4-460e-9cae-6e37960f9682 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:17.287571 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c0eb-48e4-460e-9cae-6e37960f9682 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:17.288879 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:17.294751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a7350-2b28-4a4e-82c7-474593bca414 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:17.295240 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a7350-2b28-4a4e-82c7-474593bca414 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:17.295351 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a7350-2b28-4a4e-82c7-474593bca414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:17.360287 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-fc8a7350-2b28-4a4e-82c7-474593bca414 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:17.361483 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-fc8a7350-2b28-4a4e-82c7-474593bca414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:17.390185 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:17.464270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:17.753677 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c0eb-48e4-460e-9cae-6e37960f9682 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:17.755233 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-f164c0eb-48e4-460e-9cae-6e37960f9682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:17.857852 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c0eb-48e4-460e-9cae-6e37960f9682 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:17.888494 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:17.933143 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24bb38-4296-4449-aebd-3bac552abae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:17.933836 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24bb38-4296-4449-aebd-3bac552abae5 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:17.934123 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24bb38-4296-4449-aebd-3bac552abae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:17.934401 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24bb38-4296-4449-aebd-3bac552abae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:17.936023 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-ce24bb38-4296-4449-aebd-3bac552abae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:18.049099 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24bb38-4296-4449-aebd-3bac552abae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:18.050426 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24bb38-4296-4449-aebd-3bac552abae5 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:18.067958 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 728/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:20.317382 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f1a9-9e14-40fd-8044-ff6dcccb8173 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:20.317963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f1a9-9e14-40fd-8044-ff6dcccb8173 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:20.317963 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f1a9-9e14-40fd-8044-ff6dcccb8173 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:20.319307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:20.324589 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ecad1-f45b-4444-a3fa-ecf1f3be3edf None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:20.325058 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ecad1-f45b-4444-a3fa-ecf1f3be3edf None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:20.325165 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ecad1-f45b-4444-a3fa-ecf1f3be3edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:20.390024 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-b83ecad1-f45b-4444-a3fa-ecf1f3be3edf None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:20.391182 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-b83ecad1-f45b-4444-a3fa-ecf1f3be3edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:20.399405 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:20.487492 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:20.768362 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1f1a9-9e14-40fd-8044-ff6dcccb8173 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:20.769907 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-a8b1f1a9-9e14-40fd-8044-ff6dcccb8173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:20.874232 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1f1a9-9e14-40fd-8044-ff6dcccb8173 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:20.929603 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:20.948327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0df785-0da0-492e-9ca5-4345b346ab11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:20.948936 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0df785-0da0-492e-9ca5-4345b346ab11 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:20.949289 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0df785-0da0-492e-9ca5-4345b346ab11 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:20.949575 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0df785-0da0-492e-9ca5-4345b346ab11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:20.951234 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-ef0df785-0da0-492e-9ca5-4345b346ab11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:21.057840 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0df785-0da0-492e-9ca5-4345b346ab11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:21.059191 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0df785-0da0-492e-9ca5-4345b346ab11 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:21.077282 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 732/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:23.300508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2067c-8c88-4910-b5e9-3f254720b81c None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:23.301060 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2067c-8c88-4910-b5e9-3f254720b81c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:23.301060 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2067c-8c88-4910-b5e9-3f254720b81c None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:23.302581 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:23.308397 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820aa49-eba2-440e-8bad-cb838eeca9d6 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:23.308872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820aa49-eba2-440e-8bad-cb838eeca9d6 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:23.309184 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820aa49-eba2-440e-8bad-cb838eeca9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:23.376954 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-4820aa49-eba2-440e-8bad-cb838eeca9d6 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:23.378150 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-4820aa49-eba2-440e-8bad-cb838eeca9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:23.417676 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:23.476861 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:23.762081 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2067c-8c88-4910-b5e9-3f254720b81c None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:23.763613 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-c0c2067c-8c88-4910-b5e9-3f254720b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:23.864574 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2067c-8c88-4910-b5e9-3f254720b81c None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:23.902054 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:23.939719 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca45ea-f007-40b2-ade8-43e9589c1b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:23.940325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca45ea-f007-40b2-ade8-43e9589c1b07 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:23.940608 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca45ea-f007-40b2-ade8-43e9589c1b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:23.940880 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca45ea-f007-40b2-ade8-43e9589c1b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:23.942486 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-2bca45ea-f007-40b2-ade8-43e9589c1b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:24.048220 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca45ea-f007-40b2-ade8-43e9589c1b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:24.049559 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca45ea-f007-40b2-ade8-43e9589c1b07 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:24.067254 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 731/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:26.248314 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e70a98-a8fa-4b8e-a2b9-8d6aa318420a None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:26.248889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e70a98-a8fa-4b8e-a2b9-8d6aa318420a None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:26.248889 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e70a98-a8fa-4b8e-a2b9-8d6aa318420a None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:26.250197 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:26.255448 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09980ce6-bfd2-47ed-a7d4-541810e73619 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:26.255894 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09980ce6-bfd2-47ed-a7d4-541810e73619 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:26.256009 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09980ce6-bfd2-47ed-a7d4-541810e73619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:26.320740 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-09980ce6-bfd2-47ed-a7d4-541810e73619 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:26.321946 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-09980ce6-bfd2-47ed-a7d4-541810e73619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:26.341102 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:26.418548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:26.710181 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e70a98-a8fa-4b8e-a2b9-8d6aa318420a None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:26.711734 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-b7e70a98-a8fa-4b8e-a2b9-8d6aa318420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:26.815785 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e70a98-a8fa-4b8e-a2b9-8d6aa318420a None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:26.882011 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:26.889773 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57669227-719c-4bed-a453-23e15820dac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:26.890387 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669227-719c-4bed-a453-23e15820dac8 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:26.890681 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669227-719c-4bed-a453-23e15820dac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:26.890940 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57669227-719c-4bed-a453-23e15820dac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:26.892554 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-57669227-719c-4bed-a453-23e15820dac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:27.007081 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669227-719c-4bed-a453-23e15820dac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:27.008427 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57669227-719c-4bed-a453-23e15820dac8 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:27.027158 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 735/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:29.200644 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514898-48d9-49e6-959e-846e86a94ba6 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:29.201199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514898-48d9-49e6-959e-846e86a94ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:29.201199 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514898-48d9-49e6-959e-846e86a94ba6 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:29.202548 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 14:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:29.207872 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef828f-55ea-4048-85b3-fc3f933f8b5c None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:29.208307 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef828f-55ea-4048-85b3-fc3f933f8b5c None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:29.208432 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef828f-55ea-4048-85b3-fc3f933f8b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:29.275134 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-9fef828f-55ea-4048-85b3-fc3f933f8b5c None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:29.276841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-9fef828f-55ea-4048-85b3-fc3f933f8b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:29.325344 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:29.373360 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 14:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 14:46:29.660976 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514898-48d9-49e6-959e-846e86a94ba6 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:29.662525 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a2514898-48d9-49e6-959e-846e86a94ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:29.765068 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514898-48d9-49e6-959e-846e86a94ba6 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:29.811140 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:29.836915 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ba7a3-d3fd-4598-ad29-54e0c6b57357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:29.837549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ba7a3-d3fd-4598-ad29-54e0c6b57357 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:29.837828 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ba7a3-d3fd-4598-ad29-54e0c6b57357 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:29.838097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ba7a3-d3fd-4598-ad29-54e0c6b57357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:29.839829 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-fe3ba7a3-d3fd-4598-ad29-54e0c6b57357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:29.954873 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ba7a3-d3fd-4598-ad29-54e0c6b57357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:29.957205 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ba7a3-d3fd-4598-ad29-54e0c6b57357 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:29.974925 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 734/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:39.371867 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=22 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:39.972778 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=66 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:50.113917 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ace56-5f8c-415f-82c9-ecf253773d57 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:50.114433 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ace56-5f8c-415f-82c9-ecf253773d57 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:50.114538 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ace56-5f8c-415f-82c9-ecf253773d57 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:50.116148 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 737/1471] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:50.121768 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1d8e9-e256-4bb4-98fd-aa56e6c07b07 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:50.122198 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1d8e9-e256-4bb4-98fd-aa56e6c07b07 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:50.122355 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1d8e9-e256-4bb4-98fd-aa56e6c07b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:50.187147 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-02f1d8e9-e256-4bb4-98fd-aa56e6c07b07 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:50.188347 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-02f1d8e9-e256-4bb4-98fd-aa56e6c07b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:50.289224 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 735/1472] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:50.594887 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62cd0-f405-4828-908b-f3fa6b4351ae None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:50.595204 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62cd0-f405-4828-908b-f3fa6b4351ae None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:50.595481 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae62cd0-f405-4828-908b-f3fa6b4351ae None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:50.596818 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 738/1473] 10.222.0.39 () {54 vars in 962 bytes} [Mon Oct 3 14:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:50.601697 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fd25a-21d1-48c7-a19c-89893931695d None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:50.602015 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fd25a-21d1-48c7-a19c-89893931695d None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:50.602290 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fd25a-21d1-48c7-a19c-89893931695d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:50.679428 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-5b8fd25a-21d1-48c7-a19c-89893931695d None None] MFA Rules not processed for user `f43a588d7ac34be7a8c2140a42e10dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:50.680636 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-5b8fd25a-21d1-48c7-a19c-89893931695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:50.701577 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:50.760971 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 736/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Oct 3 14:46:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:50.768719 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62cd0-f405-4828-908b-f3fa6b4351ae None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:50.770230 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-3ae62cd0-f405-4828-908b-f3fa6b4351ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:50.875763 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae62cd0-f405-4828-908b-f3fa6b4351ae None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:50.951580 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85d9d2-349f-4973-8569-23a4eae132ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a588d7ac34be7a8c2140a42e10dc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:50.952182 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d9d2-349f-4973-8569-23a4eae132ff service glance] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:50.952456 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d9d2-349f-4973-8569-23a4eae132ff service glance] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:50.952724 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d9d2-349f-4973-8569-23a4eae132ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:50.954286 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-df85d9d2-349f-4973-8569-23a4eae132ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:51.009027 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:51.065937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85d9d2-349f-4973-8569-23a4eae132ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:51.067390 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85d9d2-349f-4973-8569-23a4eae132ff service glance] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:51.085565 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 739/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:53.330811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6971d3-cf40-43f2-a19c-622f281f3c05 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:53.331369 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6971d3-cf40-43f2-a19c-622f281f3c05 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:53.331480 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6971d3-cf40-43f2-a19c-622f281f3c05 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:53.332750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 737/1476] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:53.338710 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6d208-2e26-4c23-9e64-ef4864ffa140 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:53.339214 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6d208-2e26-4c23-9e64-ef4864ffa140 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:53.339327 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6d208-2e26-4c23-9e64-ef4864ffa140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:53.405870 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-a3d6d208-2e26-4c23-9e64-ef4864ffa140 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:53.407093 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-a3d6d208-2e26-4c23-9e64-ef4864ffa140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:53.505886 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 740/1477] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:53.778196 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6971d3-cf40-43f2-a19c-622f281f3c05 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:53.779701 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-fb6971d3-cf40-43f2-a19c-622f281f3c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:53.905389 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6971d3-cf40-43f2-a19c-622f281f3c05 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:53.954964 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:53.999900 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584faa2-8a8c-4c67-9010-452b851517fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:54.000496 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584faa2-8a8c-4c67-9010-452b851517fa admin admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:54.000771 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584faa2-8a8c-4c67-9010-452b851517fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:54.001038 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584faa2-8a8c-4c67-9010-452b851517fa admin admin] PATH_INFO: `/v3/projects` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:54.001659 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584faa2-8a8c-4c67-9010-452b851517fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:54.003386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: WARNING py.warnings [None req-4584faa2-8a8c-4c67-9010-452b851517fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 14:46:54.003386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: warnings.warn(msg) Oct 03 14:46:54.003386 dv-cinder-859877-2-smb devstack@keystone.service[87856]: Oct 03 14:46:54.004513 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584faa2-8a8c-4c67-9010-452b851517fa admin admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:54.023441 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 738/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Oct 3 14:46:53 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 14:46:56.194340 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a8aab-701b-48bb-912f-1ef3021d3c87 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:56.194890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a8aab-701b-48bb-912f-1ef3021d3c87 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:56.194890 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a8aab-701b-48bb-912f-1ef3021d3c87 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:56.196278 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 741/1479] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:56.201996 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de690d2-ae3f-463a-b8cb-b8dbff6bef5c None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:56.202437 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de690d2-ae3f-463a-b8cb-b8dbff6bef5c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:56.202547 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de690d2-ae3f-463a-b8cb-b8dbff6bef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:56.268274 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-2de690d2-ae3f-463a-b8cb-b8dbff6bef5c None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:56.269474 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-2de690d2-ae3f-463a-b8cb-b8dbff6bef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:56.364067 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 739/1480] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:56.665021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a8aab-701b-48bb-912f-1ef3021d3c87 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:56.667693 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-c06a8aab-701b-48bb-912f-1ef3021d3c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:56.677398 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:56.813609 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a8aab-701b-48bb-912f-1ef3021d3c87 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:46:56.891846 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:56.924913 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbe51a-531e-4ad0-a647-a605218ff959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfb0254e89514ff18e1c91dc427e4b1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:46:56.925449 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe51a-531e-4ad0-a647-a605218ff959 service nova] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:56.925728 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe51a-531e-4ad0-a647-a605218ff959 service nova] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:56.925994 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe51a-531e-4ad0-a647-a605218ff959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:56.927606 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-6dbbe51a-531e-4ad0-a647-a605218ff959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:57.016961 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbe51a-531e-4ad0-a647-a605218ff959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:46:57.018528 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbe51a-531e-4ad0-a647-a605218ff959 service nova] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:46:57.036261 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 742/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:46:59.383055 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3543b-2feb-4777-9968-0a3c1f800e37 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:59.383584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3543b-2feb-4777-9968-0a3c1f800e37 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:59.383584 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3543b-2feb-4777-9968-0a3c1f800e37 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:59.385391 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 740/1482] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:46:59.391143 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67dcf0-70b4-426b-9dfe-b88214292440 None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:46:59.391602 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67dcf0-70b4-426b-9dfe-b88214292440 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:46:59.391716 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67dcf0-70b4-426b-9dfe-b88214292440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:46:59.458364 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-de67dcf0-70b4-426b-9dfe-b88214292440 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:46:59.459621 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-de67dcf0-70b4-426b-9dfe-b88214292440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:59.506837 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:59.558136 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 743/1483] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:46:59.849785 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3543b-2feb-4777-9968-0a3c1f800e37 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:46:59.851360 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-47f3543b-2feb-4777-9968-0a3c1f800e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:46:59.875304 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:46:59.955113 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3543b-2feb-4777-9968-0a3c1f800e37 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:47:00.030451 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1625767-0f60-4bfc-acb5-2c27c1b1d854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:47:00.031097 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1625767-0f60-4bfc-acb5-2c27c1b1d854 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:00.031380 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1625767-0f60-4bfc-acb5-2c27c1b1d854 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:00.031659 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1625767-0f60-4bfc-acb5-2c27c1b1d854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:00.033243 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a1625767-0f60-4bfc-acb5-2c27c1b1d854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:00.108684 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:00.148745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1625767-0f60-4bfc-acb5-2c27c1b1d854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:47:00.150229 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1625767-0f60-4bfc-acb5-2c27c1b1d854 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:47:00.168631 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 741/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:47:02.389695 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a4704-43a8-47ce-b791-143abf4ba264 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:02.390221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a4704-43a8-47ce-b791-143abf4ba264 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:02.390221 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a4704-43a8-47ce-b791-143abf4ba264 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:02.391549 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 744/1485] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:47:02.397083 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4fdd6-d985-4981-8363-945313c7d7d6 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:02.397522 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4fdd6-d985-4981-8363-945313c7d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:02.397632 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4fdd6-d985-4981-8363-945313c7d7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:02.464212 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-0bd4fdd6-d985-4981-8363-945313c7d7d6 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:47:02.465407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-0bd4fdd6-d985-4981-8363-945313c7d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:02.560882 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 742/1486] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:47:02.849424 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a4704-43a8-47ce-b791-143abf4ba264 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:47:02.851043 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-5f2a4704-43a8-47ce-b791-143abf4ba264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:02.953991 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a4704-43a8-47ce-b791-143abf4ba264 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:47:03.025686 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:03.027090 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f5526-0991-4da4-acb4-ede00d9c0148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:47:03.027919 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f5526-0991-4da4-acb4-ede00d9c0148 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:03.028383 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f5526-0991-4da4-acb4-ede00d9c0148 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:03.028816 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f5526-0991-4da4-acb4-ede00d9c0148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:03.030564 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-0f5f5526-0991-4da4-acb4-ede00d9c0148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:03.141769 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f5526-0991-4da4-acb4-ede00d9c0148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:47:03.143270 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f5526-0991-4da4-acb4-ede00d9c0148 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:47:03.161502 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 745/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:47:05.415980 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6f1d5-4795-401b-9bb1-00968499ba64 None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:05.416506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6f1d5-4795-401b-9bb1-00968499ba64 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:05.416506 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6f1d5-4795-401b-9bb1-00968499ba64 None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:05.417800 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 743/1488] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:47:05.423052 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ee00f-5fd3-42b0-bd7f-b06712cd5bbb None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:05.423477 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ee00f-5fd3-42b0-bd7f-b06712cd5bbb None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:05.423630 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ee00f-5fd3-42b0-bd7f-b06712cd5bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:05.494041 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-061ee00f-5fd3-42b0-bd7f-b06712cd5bbb None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:47:05.495380 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-061ee00f-5fd3-42b0-bd7f-b06712cd5bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:05.546738 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:05.590667 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 746/1489] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:47:05.887716 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6f1d5-4795-401b-9bb1-00968499ba64 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:47:05.889305 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-52d6f1d5-4795-401b-9bb1-00968499ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:05.925014 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:05.992669 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6f1d5-4795-401b-9bb1-00968499ba64 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:47:06.066858 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dd537-3484-4492-a208-6d02392bda98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:47:06.067472 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dd537-3484-4492-a208-6d02392bda98 service neutron] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:06.067750 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dd537-3484-4492-a208-6d02392bda98 service neutron] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:06.068027 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dd537-3484-4492-a208-6d02392bda98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:06.069582 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-526dd537-3484-4492-a208-6d02392bda98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:06.149706 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:06.178652 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526dd537-3484-4492-a208-6d02392bda98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:47:06.180107 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526dd537-3484-4492-a208-6d02392bda98 service neutron] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:47:06.198791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 744/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:47:08.648042 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02328dfe-9b01-498b-a40e-615805179b85 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:08.648600 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02328dfe-9b01-498b-a40e-615805179b85 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:08.648600 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02328dfe-9b01-498b-a40e-615805179b85 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:08.650682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 747/1491] 10.222.0.39 () {54 vars in 927 bytes} [Mon Oct 3 14:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 14:47:08.655965 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde63cf-3b07-401a-88c2-ba5943711863 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:08.656407 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde63cf-3b07-401a-88c2-ba5943711863 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:08.656517 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde63cf-3b07-401a-88c2-ba5943711863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:08.721783 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-bcde63cf-3b07-401a-88c2-ba5943711863 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:47:08.723012 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-bcde63cf-3b07-401a-88c2-ba5943711863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:08.818906 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 745/1492] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Oct 3 14:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:47:09.110513 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02328dfe-9b01-498b-a40e-615805179b85 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:47:09.112127 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-02328dfe-9b01-498b-a40e-615805179b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:09.213928 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02328dfe-9b01-498b-a40e-615805179b85 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:47:09.288267 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac0ddf-9eb9-421c-b25b-ec858626c626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:47:09.288878 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac0ddf-9eb9-421c-b25b-ec858626c626 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:47:09.289161 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac0ddf-9eb9-421c-b25b-ec858626c626 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:47:09.289435 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac0ddf-9eb9-421c-b25b-ec858626c626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:47:09.291611 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-8aac0ddf-9eb9-421c-b25b-ec858626c626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:47:09.300293 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:09.402600 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac0ddf-9eb9-421c-b25b-ec858626c626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:47:09.403957 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac0ddf-9eb9-421c-b25b-ec858626c626 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:47:09.422751 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 748/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:47:18.817473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=82 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:47:19.420511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=50 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:22.653888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cd54f-764c-48ba-9fa1-9d1887e25ca6 None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:22.654468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cd54f-764c-48ba-9fa1-9d1887e25ca6 None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:22.654468 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cd54f-764c-48ba-9fa1-9d1887e25ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:22.731661 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-ff0cd54f-764c-48ba-9fa1-9d1887e25ca6 None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:48:22.732850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-ff0cd54f-764c-48ba-9fa1-9d1887e25ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:22.832121 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 746/1494] 10.222.0.39 () {58 vars in 958 bytes} [Mon Oct 3 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:48:22.840200 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e87f4-a9f1-4f5f-a7a2-9d20a8de9ced None None] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:22.840682 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e87f4-a9f1-4f5f-a7a2-9d20a8de9ced None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:22.840780 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e87f4-a9f1-4f5f-a7a2-9d20a8de9ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:22.918418 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.auth.core [None req-be3e87f4-a9f1-4f5f-a7a2-9d20a8de9ced None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87857) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:48:22.919580 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-be3e87f4-a9f1-4f5f-a7a2-9d20a8de9ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:23.015477 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 749/1495] 10.222.0.39 () {58 vars in 958 bytes} [Mon Oct 3 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:48:23.020114 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cd54f-764c-48ba-9fa1-9d1887e25ca6 None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:23.021309 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-ff0cd54f-764c-48ba-9fa1-9d1887e25ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:23.033152 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cd54f-764c-48ba-9fa1-9d1887e25ca6 None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:23.093396 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:23.127674 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:23.128286 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:23.128565 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:23.128838 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:23.129467 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87856) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 14:48:23.129766 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:23.130794 dv-cinder-859877-2-smb devstack@keystone.service[87856]: WARNING py.warnings [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 14:48:23.130794 dv-cinder-859877-2-smb devstack@keystone.service[87856]: warnings.warn(msg) Oct 03 14:48:23.130794 dv-cinder-859877-2-smb devstack@keystone.service[87856]: Oct 03 14:48:23.131693 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:23.142860 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 747/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Oct 3 14:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 14:48:23.151594 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e87f4-a9f1-4f5f-a7a2-9d20a8de9ced None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:23.160783 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e87f4-a9f1-4f5f-a7a2-9d20a8de9ced None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:23.221603 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:23.254761 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:23.255387 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] REQUEST_METHOD: `POST` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:23.255664 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:23.255935 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:23.256561 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:23.258248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: WARNING py.warnings [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 14:48:23.258248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: warnings.warn(msg) Oct 03 14:48:23.258248 dv-cinder-859877-2-smb devstack@keystone.service[87857]: Oct 03 14:48:23.259551 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:23.316352 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 750/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Oct 3 14:48:23 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:48:23.321380 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:23.322912 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:23.356508 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6745a-a4fa-4294-90f5-fa0039d1faa8 admin admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:23.450280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:23.450888 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:23.451264 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:23.451534 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] PATH_INFO: `/v3/users` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:23.452163 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:23.453158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: WARNING py.warnings [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 14:48:23.453158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: warnings.warn(msg) Oct 03 14:48:23.453158 dv-cinder-859877-2-smb devstack@keystone.service[87856]: Oct 03 14:48:23.454349 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:23.497424 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 748/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Oct 3 14:48:23 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 14:48:23.501466 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:23.503040 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:23.566283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca731b90-05e2-45be-88c4-cf18788a5d67 admin admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:23.651937 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:23.663646 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:23.664286 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:23.664569 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:23.664841 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:23.665470 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:23.666463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: WARNING py.warnings [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 14:48:23.666463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: warnings.warn(msg) Oct 03 14:48:23.666463 dv-cinder-859877-2-smb devstack@keystone.service[87857]: Oct 03 14:48:23.667389 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:23.680622 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 751/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Oct 3 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 14:48:23.684819 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:23.686323 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:23.698325 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd9b4-2713-40b3-bde8-f2c5bc9999c0 admin admin] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:23.722557 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:23.791156 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fca2a9-a7dd-4923-8749-371765f7cc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:23.791685 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fca2a9-a7dd-4923-8749-371765f7cc55 admin admin] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:23.791961 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fca2a9-a7dd-4923-8749-371765f7cc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:23.792232 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fca2a9-a7dd-4923-8749-371765f7cc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:23.792853 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fca2a9-a7dd-4923-8749-371765f7cc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:23.793850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: WARNING py.warnings [None req-16fca2a9-a7dd-4923-8749-371765f7cc55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 14:48:23.793850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: warnings.warn(msg) Oct 03 14:48:23.793850 dv-cinder-859877-2-smb devstack@keystone.service[87856]: Oct 03 14:48:23.794714 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fca2a9-a7dd-4923-8749-371765f7cc55 admin admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:23.807376 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 749/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Oct 3 14:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 14:48:23.811567 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:23.813091 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:23.847190 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96e750-bfe2-4546-b177-10b80e852ffe admin admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:23.940498 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eda049-1603-48d4-a33a-20e3039b4c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:23.941156 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda049-1603-48d4-a33a-20e3039b4c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:23.941441 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda049-1603-48d4-a33a-20e3039b4c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:23.941718 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eda049-1603-48d4-a33a-20e3039b4c63 admin admin] PATH_INFO: `/v3/projects/2018c7dc74014e178b1e60c35bef7ebf/users/e8b1d3f9396149ee8c748db9378057f0/roles/5039147f7bed444380ba0a7d7b6c2269` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:23.964503 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eda049-1603-48d4-a33a-20e3039b4c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2018c7dc74014e178b1e60c35bef7ebf, user_id=e8b1d3f9396149ee8c748db9378057f0, role_id=5039147f7bed444380ba0a7d7b6c2269)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:23.965511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: WARNING py.warnings [None req-f6eda049-1603-48d4-a33a-20e3039b4c63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 14:48:23.965511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: warnings.warn(msg) Oct 03 14:48:23.965511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: Oct 03 14:48:23.967482 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eda049-1603-48d4-a33a-20e3039b4c63 admin admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:23.993035 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 752/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Oct 3 14:48:23 2022] PUT /identity/v3/projects/2018c7dc74014e178b1e60c35bef7ebf/users/e8b1d3f9396149ee8c748db9378057f0/roles/5039147f7bed444380ba0a7d7b6c2269 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:48:24.005184 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca529-bc1f-4692-bf55-fd21df99db4c None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:24.005466 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca529-bc1f-4692-bf55-fd21df99db4c None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:24.005745 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca529-bc1f-4692-bf55-fd21df99db4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:24.062674 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-c10ca529-bc1f-4692-bf55-fd21df99db4c None None] MFA Rules not processed for user `e8b1d3f9396149ee8c748db9378057f0`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:48:24.063811 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-c10ca529-bc1f-4692-bf55-fd21df99db4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:24.139189 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 750/1502] 10.222.0.39 () {58 vars in 958 bytes} [Mon Oct 3 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:48:24.152200 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ce1b-1282-43e8-93c0-5f004c740387 None None] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:24.152493 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ce1b-1282-43e8-93c0-5f004c740387 None None] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:24.152799 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79ce1b-1282-43e8-93c0-5f004c740387 None None] PATH_INFO: `/` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:24.154131 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 753/1503] 10.222.0.39 () {54 vars in 963 bytes} [Mon Oct 3 14:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:48:24.159006 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d7814-7b6a-4025-8650-a57fb8e17eaf None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:24.159295 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d7814-7b6a-4025-8650-a57fb8e17eaf None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:24.159601 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d7814-7b6a-4025-8650-a57fb8e17eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:24.191580 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:24.235535 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-d91d7814-7b6a-4025-8650-a57fb8e17eaf None None] MFA Rules not processed for user `986544a87d444d57a9f6b2018f11967d`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:48:24.236732 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-d91d7814-7b6a-4025-8650-a57fb8e17eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:24.311883 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 751/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Mon Oct 3 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:48:24.320021 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ce1b-1282-43e8-93c0-5f004c740387 None None] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:24.321530 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-9d79ce1b-1282-43e8-93c0-5f004c740387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:24.373970 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:24.428160 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79ce1b-1282-43e8-93c0-5f004c740387 None None] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:24.502623 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '986544a87d444d57a9f6b2018f11967d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:24.503251 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:24.503527 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:24.503795 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:24.505347 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:24.607865 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:24.609283 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:24.612695 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:24.631980 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 754/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:48:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:48:24.677549 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04998642-218b-4677-967b-fa62e40062dd None None] REQUEST_METHOD: `GET` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:24.677960 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04998642-218b-4677-967b-fa62e40062dd None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:24.678371 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04998642-218b-4677-967b-fa62e40062dd None None] PATH_INFO: `/` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:24.679791 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 752/1506] 10.222.0.39 () {52 vars in 830 bytes} [Mon Oct 3 14:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 14:48:24.683226 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:24.684412 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:24.781540 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccf086-b7f6-4ee8-a8be-6f9d19713953 service cinder] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:24.875070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:24.875714 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:24.875914 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:24.876188 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] PATH_INFO: `/v3/users/e8b1d3f9396149ee8c748db9378057f0` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:24.889550 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b1d3f9396149ee8c748db9378057f0)` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:24.890553 dv-cinder-859877-2-smb devstack@keystone.service[87857]: WARNING py.warnings [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 14:48:24.890553 dv-cinder-859877-2-smb devstack@keystone.service[87857]: warnings.warn(msg) Oct 03 14:48:24.890553 dv-cinder-859877-2-smb devstack@keystone.service[87857]: Oct 03 14:48:24.891793 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:24.902054 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=100 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:24.957511 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b1d3f9396149ee8c748db9378057f0'} {{(pid=87857) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:24.967541 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b1d3f9396149ee8c748db9378057f0'} {{(pid=87857) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:24.968070 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b1d3f9396149ee8c748db9378057f0'} {{(pid=87857) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:24.994093 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b1d3f9396149ee8c748db9378057f0'} {{(pid=87857) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:25.008601 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.notifications [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b1d3f9396149ee8c748db9378057f0'} {{(pid=87857) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:25.014450 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 755/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Oct 3 14:48:24 2022] DELETE /identity/v3/users/e8b1d3f9396149ee8c748db9378057f0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:48:25.018830 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ea49e-ee5c-431f-b70e-06181bc0d8be None None] REQUEST_METHOD: `POST` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:25.019399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ea49e-ee5c-431f-b70e-06181bc0d8be None None] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:25.019399 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ea49e-ee5c-431f-b70e-06181bc0d8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:25.076280 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.auth.core [None req-c27ea49e-ee5c-431f-b70e-06181bc0d8be None None] MFA Rules not processed for user `eb12f0f56c9240608c4e9af189715bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87856) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 14:48:25.077473 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-c27ea49e-ee5c-431f-b70e-06181bc0d8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:25.154440 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=100 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:25.167354 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 753/1508] 10.222.0.39 () {58 vars in 958 bytes} [Mon Oct 3 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 14:48:25.176839 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] Authenticating user token {{(pid=87857) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:25.178668 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:25.276409 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ea92d-43aa-428e-bfbe-4abf64175b81 admin admin] Validating token access rules against request {{(pid=87857) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:25.329920 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:25.349300 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fac62d-fcab-4cc6-be0a-70b834229fe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0561a97f1a4d4f469cb5c2103e2541f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '381e0d308a204c05a7713bbf78d599fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87857) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:25.350497 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fac62d-fcab-4cc6-be0a-70b834229fe8 service neutron] REQUEST_METHOD: `GET` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:25.350774 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fac62d-fcab-4cc6-be0a-70b834229fe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:25.351082 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fac62d-fcab-4cc6-be0a-70b834229fe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87857) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:25.352651 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.fernet_utils [None req-69fac62d-fcab-4cc6-be0a-70b834229fe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87857) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:25.460192 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fac62d-fcab-4cc6-be0a-70b834229fe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:25.461535 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fac62d-fcab-4cc6-be0a-70b834229fe8 service neutron] RBAC: Authorization granted {{(pid=87857) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:25.480143 dv-cinder-859877-2-smb devstack@keystone.service[87857]: [pid: 87857|app: 0|req: 756/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Oct 3 14:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 14:48:25.819578 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ea49e-ee5c-431f-b70e-06181bc0d8be None None] Authenticating user token {{(pid=87856) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 14:48:25.820913 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.fernet_utils [None req-c27ea49e-ee5c-431f-b70e-06181bc0d8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87856) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 14:48:25.832890 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ea49e-ee5c-431f-b70e-06181bc0d8be None None] Validating token access rules against request {{(pid=87856) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 14:48:25.931986 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb12f0f56c9240608c4e9af189715bfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf0b8451292a4b79a7b878d287636467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87856) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 14:48:25.932622 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 14:48:25.932927 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] SCRIPT_NAME: `/identity` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 14:48:25.933184 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] PATH_INFO: `/v3/projects/2018c7dc74014e178b1e60c35bef7ebf` {{(pid=87856) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 14:48:25.943000 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2018c7dc74014e178b1e60c35bef7ebf)` {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 14:48:25.944680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: WARNING py.warnings [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 14:48:25.944680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: warnings.warn(msg) Oct 03 14:48:25.944680 dv-cinder-859877-2-smb devstack@keystone.service[87856]: Oct 03 14:48:25.945867 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] RBAC: Authorization granted {{(pid=87856) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 14:48:26.003036 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2018c7dc74014e178b1e60c35bef7ebf', 'request_id': 'req-b0b7a9e1-d540-4796-ad00-39ca82b9157b'} {{(pid=87856) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:26.011248 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2018c7dc74014e178b1e60c35bef7ebf', 'request_id': 'req-b0b7a9e1-d540-4796-ad00-39ca82b9157b'} {{(pid=87856) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:26.024679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2018c7dc74014e178b1e60c35bef7ebf', 'request_id': 'req-b0b7a9e1-d540-4796-ad00-39ca82b9157b'} {{(pid=87856) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:26.050843 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] The token cache is being invalidate because project 2018c7dc74014e178b1e60c35bef7ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87856) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 14:48:26.051166 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87856) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:26.051679 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG keystone.notifications [None req-b0b7a9e1-d540-4796-ad00-39ca82b9157b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87856) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 14:48:26.053959 dv-cinder-859877-2-smb devstack@keystone.service[87856]: [pid: 87856|app: 0|req: 754/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Oct 3 14:48:25 2022] DELETE /identity/v3/projects/2018c7dc74014e178b1e60c35bef7ebf => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 14:48:35.478013 dv-cinder-859877-2-smb devstack@keystone.service[87857]: DEBUG dbcounter [-] [87857] Writing DB stats keystone:SELECT=62 {{(pid=87857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 14:48:36.048833 dv-cinder-859877-2-smb devstack@keystone.service[87856]: DEBUG dbcounter [-] [87856] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}